Apr 17 05:22:13 devstack cinder-volume[72247]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 17 05:22:13 devstack cinder-volume[72247]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 17 05:22:13 devstack cinder-volume[72247]: we strongly recommend against using it for new projects.
Apr 17 05:22:13 devstack cinder-volume[72247]: If you are already using Eventlet, we recommend migrating to a different
Apr 17 05:22:13 devstack cinder-volume[72247]: framework.  For more detail see
Apr 17 05:22:13 devstack cinder-volume[72247]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 17 05:22:13 devstack cinder-volume[72247]:   import eventlet  # noqa
Apr 17 05:22:15 devstack cinder-volume[72247]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 17 05:22:15 devstack cinder-volume[72247]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 17 05:22:15 devstack cinder-volume[72247]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 17 05:22:15 devstack cinder-volume[72247]: INFO dbcounter [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Registered counter for database cinder
Apr 17 05:22:15 devstack cinder-volume[72247]: DEBUG oslo_db.sqlalchemy.engines [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:22:15 devstack cinder-volume[72247]: DEBUG dbcounter [-] [72247] Writer thread running {{(pid=72247) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 17 05:22:15 devstack cinder-volume[72247]: INFO cinder.rpc [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 17 05:22:15 devstack cinder-volume[72247]: INFO cinder.rpc [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 17 05:22:15 devstack cinder-volume[72247]: DEBUG oslo_db.sqlalchemy.engines [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:22:16 devstack cinder-volume[72247]: INFO cinder.volume.manager [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Determined volume DB was empty at startup.
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG cinder.volume.manager [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72247) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 17 05:22:16 devstack cinder-volume[72247]: INFO cinder.volume.manager [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 17 05:22:16 devstack cinder-volume[72247]: WARNING stevedore.named [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 17 05:22:16 devstack cinder-volume[72247]: WARNING castellan.key_manager [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 17 05:22:16 devstack cinder-volume[72247]: WARNING cinder.keymgr.conf_key_mgr [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG cinder.volume.drivers.lvm [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72247) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_concurrency.processutils [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_concurrency.processutils [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] CMD "cinder-rtstool verify" returned: 0 in 0.231s {{(pid=72247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_db.sqlalchemy.engines [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:22:16 devstack cinder-volume[72247]: INFO cinder.rpc [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 17 05:22:16 devstack cinder-volume[72247]: INFO cinder.rpc [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 17 05:22:16 devstack cinder-volume[72247]: WARNING stevedore.named [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 17 05:22:16 devstack cinder-volume[72247]: WARNING castellan.key_manager [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 17 05:22:16 devstack cinder-volume[72247]: INFO cinder.volume.manager [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_db.sqlalchemy.engines [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:22:16 devstack cinder-volume[72247]: INFO oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Starting 1 workers
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Started child 72353 {{(pid=72247) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Full set of CONF: {{(pid=72247) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] ******************************************************************************** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Configuration options gathered from: {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] ================================================================================ {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] allow_availability_zone_fallback = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] allow_compression_on_image_upload = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] allowed_direct_url_schemes     = [] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] api_rate_limit                 = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] auth_strategy                  = keystone {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] az_cache_duration              = 3600 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_availability_zone      = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_host                   = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_name                   = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_stats_polling_interval = 60 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backup_api_class               = cinder.backup.api.API {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backup_name_template           = backup-%s {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backup_use_same_host           = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backup_use_temp_snapshot       = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] chap_password                  = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] chap_username                  =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cinder_internal_tenant_project_id = 6ed9d3130403400b8fdf7a18be60ac22 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cinder_internal_tenant_user_id = 9e1e4c30b3de41c4bd7666ef782d2a77 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cloned_volume_same_az          = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cluster                        = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] compression_format             = gzip {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] compute_api_class              = cinder.compute.nova.API {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] config_dir                     = [] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] config_source                  = [] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] control_exchange               = openstack {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] debug                          = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] default_availability_zone      = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] default_group_type             = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] default_volume_type            = lvmdriver-1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] disk_geometry                  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] driver_client_cert             = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] driver_client_cert_key         = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] driver_data_namespace          = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] driver_ssl_cert_path           = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] driver_ssl_cert_verify         = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] driver_use_ssl                 = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] enable_force_upload            = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] enable_new_services            = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] enable_unsupported_driver      = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] enforce_multipath_for_image_xfer = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] filter_function                = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance_api_insecure            = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance_api_servers             = ['http://192.168.122.226/image'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance_api_ssl_compression     = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance_ca_certificates_file    = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance_catalog_info            = image:glance:publicURL {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance_certfile                = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance_keyfile                 = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance_num_retries             = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance_request_timeout         = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] goodness_function              = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] graceful_shutdown_timeout      = 5 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] group_api_class                = cinder.group.api.API {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] host                           = devstack {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] image_compress_on_upload       = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] image_conversion_address_space_limit = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] image_conversion_cpu_limit     = 60 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] image_conversion_disable       = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] image_upload_use_cinder_backend = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] image_upload_use_internal_tenant = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] image_volume_cache_enabled     = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] image_volume_cache_max_count   = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] image_volume_cache_max_size_gb = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] init_host_max_objects_retrieval = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] instance_format                = [instance: %(uuid)s]  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] iscsi_target_flags             =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] iscsi_write_cache              = on {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] iser_helper                    = tgtadm {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72353]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] iser_ip_address                = 192.168.122.226 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] iser_port                      = 3260 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] log_color                      = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] log_config_append              = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] log_dir                        = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] log_file                       = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] log_options                    = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] log_rotate_interval            = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] log_rotate_interval_type       = days {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] log_rotation_type              = none {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] max_age                        = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] max_logfile_count              = 30 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] max_logfile_size_mb            = 200 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] max_over_subscription_ratio    = 20.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] message_reap_interval          = 86400 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] message_ttl                    = 2592000 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] migration_create_volume_timeout_secs = 300 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] monkey_patch                   = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] monkey_patch_modules           = [] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] my_ip                          = 192.168.122.226 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] no_snapshot_gb_quota           = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] num_iser_scan_tries            = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] num_shell_tries                = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] num_volume_device_scan_tries   = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] nvmeof_conn_info_version       = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] nvmet_ns_id                    = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] nvmet_port_id                  = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] osapi_max_limit                = 1000 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] osapi_volume_ext_list          = [] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] osapi_volume_listen_port       = 8776 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] osapi_volume_use_ssl           = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] osapi_volume_workers           = 2 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] per_volume_size_limit          = -1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] periodic_fuzzy_delay           = 60 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] periodic_interval              = 60 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] public_endpoint                = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] publish_errors                 = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] quota_backup_gigabytes         = 1000 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] quota_backups                  = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] quota_gigabytes                = 1000 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] quota_groups                   = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] quota_snapshots                = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] quota_volumes                  = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] rate_limit_burst               = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] rate_limit_except_level        = CRITICAL {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] rate_limit_interval            = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] reinit_driver_count            = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] replication_device             = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] report_discard_supported       = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] report_interval                = 120 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] reservation_clean_interval     = 86400 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] reservation_expire             = 86400 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] reserved_image_namespaces      = [] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] reserved_percentage            = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] rpc_response_timeout           = 120 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] run_external_periodic_tasks    = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] scst_target_driver             = iscsi {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] scst_target_iqn_name           = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_down_time              = 720 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] shell_completion               = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] snapshot_name_template         = snapshot-%s {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] snapshot_same_host             = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] split_loggers                  = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] state_path                     = /opt/stack/data/cinder {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] storage_availability_zone      = nova {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] storage_protocol               = iSCSI {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] syslog_log_facility            = LOG_USER {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] target_helper                  = lioadm {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] target_ip_address              = 192.168.122.226 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] target_port                    = 3260 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] target_protocol                = iscsi {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] target_secondary_ip_addresses  = [] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] trace_flags                    = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] transport_url                  = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] until_refresh                  = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] use_chap_auth                  = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] use_default_quota_class        = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] use_journal                    = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] use_json                       = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] use_multipath_for_image_xfer   = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] use_stderr                     = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] use_syslog                     = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] verify_glance_signatures       = enabled {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_api_class               = cinder.volume.api.API {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_backend_name            = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_clear                   = zero {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_clear_ionice            = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_clear_size              = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_copy_bps_limit          = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_dd_blocksize            = 1M {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_name_template           = volume-%s {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_service_inithost_offload = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volume_usage_audit_period      = month {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] zoning_mode                    = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_concurrency.disable_process_locking = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.admin_password = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.admin_token = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.admin_user  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.auth_port   = 35357 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.auth_protocol = https {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.auth_section = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.auth_type   = password {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.auth_uri    = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.auth_version = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.cache       = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.certfile    = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.delay_auth_decision = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.http_connect_timeout = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.identity_uri = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.include_service_catalog = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.insecure    = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.interface   = public {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.keyfile     = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_password =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcache_username =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.region_name = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.service_token_roles_required = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.service_type = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.token_cache_time = 300 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.226/identity {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.backend                  = dogpile.cache.null {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.backend_argument         = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.backend_expiration_time  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.config_prefix            = cache.oslo {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.debug_cache_backend      = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.enable_retry_client      = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.enable_socket_keepalive  = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.enabled                  = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.enforce_fips_mode        = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.expiration_time          = 600 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.hashclient_retry_attempts = 2 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.memcache_dead_retry      = 300 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.memcache_pool_maxsize    = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.memcache_sasl_enabled    = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.password                 = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.proxies                  = [] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.redis_db                 = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.redis_sentinel_service_name = mymaster {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.redis_server             = localhost:6379 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.retry_attempts           = 2 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.retry_delay              = 0.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.socket_keepalive_count   = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.socket_keepalive_idle    = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.socket_keepalive_interval = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.socket_timeout           = 1.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.tls_allowed_ciphers      = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.tls_cafile               = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.tls_certfile             = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.tls_enabled              = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.tls_keyfile              = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cache.username                 = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] coordination.backend_url       = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.asyncio_connection    = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.asyncio_slave_connection = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.backend               = sqlalchemy {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.connection            = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.connection_debug      = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.connection_parameters =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.connection_recycle_time = 3600 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.connection_trace      = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.db_inc_retry_interval = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.db_max_retries        = 20 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.db_max_retry_interval = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.db_retry_interval     = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.max_overflow          = 50 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.max_pool_size         = 5 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.max_retries           = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.mysql_wsrep_sync_wait = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.pool_timeout          = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.retry_interval        = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.slave_connection      = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.sqlite_synchronous    = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.synchronous_reader    = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] database.use_db_reconnect      = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.connection_string     = messaging:// {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.enabled               = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.es_doc_type           = notification {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.es_scroll_size        = 10000 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.es_scroll_time        = 2m {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.filter_error_trace    = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.hmac_keys             = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.sentinel_service_name = mymaster {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.socket_timeout        = 0.1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.trace_requests        = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler.trace_sqlalchemy      = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler_jaeger.process_tags   = {} {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler_jaeger.service_name_prefix = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] profiler_otlp.service_name_prefix = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.enforce_new_defaults = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: WARNING oslo_config.cfg [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.enforce_scope      = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.policy_default_rule = default {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.policy_file        = policy.yaml {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] privsep_osbrick.group          = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] privsep_osbrick.helper_command = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72353]: INFO cinder.volume.manager [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] privsep_osbrick.user           = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cinder_sys_admin.group         = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cinder_sys_admin.helper_command = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] cinder_sys_admin.user          = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_user.auth_section      = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_user.auth_type         = password {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_user.cafile            = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_user.certfile          = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_user.collect_timing    = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_user.insecure          = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_user.keyfile           = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_user.send_service_user_token = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_user.split_loggers     = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] service_user.timeout           = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance.auth_section            = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance.auth_type               = password {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance.certfile                = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance.collect_timing          = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance.insecure                = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance.keyfile                 = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance.region_name             = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance.split_loggers           = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] glance.timeout                 = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.backend_availability_zone = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.chap_password = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.chap_username =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.disk_geometry = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.driver_client_cert = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.driver_client_cert_key = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.driver_data_namespace = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.driver_use_ssl = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.enable_unsupported_driver = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.extra_capabilities = {} {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.filter_function = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.goodness_function = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.iscsi_target_flags =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.iscsi_write_cache = on {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.iser_helper   = tgtadm {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.iser_port     = 3260 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.lvm_share_target = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.lvm_type      = auto {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.num_shell_tries = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.nvmet_port_id = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.replication_device = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.report_discard_supported = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.reserved_percentage = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.scst_target_driver = iscsi {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.scst_target_iqn_name = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.storage_protocol = iSCSI {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.target_helper = tgtadm {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.target_port   = 3260 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.target_protocol = iscsi {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.trace_flags   = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.unique_fqdn_network = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.use_chap_auth = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.volume_backend_name = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.volume_clear  = zero {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.volume_clear_ionice = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.volume_clear_size = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_reports.file_event_handler = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_reports.log_dir           = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.backend_availability_zone = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.backend_host       = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.chap_password      = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.chap_username      = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.disk_geometry      = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.driver_client_cert = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.driver_data_namespace = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.extra_capabilities = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.filter_function    = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.goodness_function  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.iser_helper        = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.iser_ip_address    = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.iser_port          = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.iser_target_prefix = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.lvm_share_target   = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.lvm_type           = auto {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.num_shell_tries    = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.replication_device = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.report_discard_supported = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.reserved_percentage = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.scst_target_driver = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.storage_protocol   = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.target_helper      = lioadm {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.target_ip_address  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.target_port        = 3260 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.trace_flags        = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.use_chap_auth      = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.volume_clear       = zero {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.volume_clear_size  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] lvmdriver-1.volumes_dir        = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.ssl      = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_notifications.driver = [] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_notifications.retry = -1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] oslo_messaging_notifications.transport_url = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] key_manager.fixed_key          = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.barbican_api_version  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.barbican_endpoint     = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.barbican_endpoint_type = public {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.barbican_region_name  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.cafile                = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.certfile              = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.collect_timing        = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.insecure              = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.keyfile               = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.number_of_retries     = 60 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.retry_delay           = 1 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.send_service_user_token = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.split_loggers         = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.timeout               = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.verify_ssl            = True {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican.verify_ssl_path       = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican_service_user.auth_section = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican_service_user.auth_type = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican_service_user.cafile   = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican_service_user.certfile = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican_service_user.collect_timing = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican_service_user.insecure = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican_service_user.keyfile  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican_service_user.split_loggers = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] barbican_service_user.timeout  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.approle_role_id          = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.approle_secret_id        = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.kv_mountpoint            = secret {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.kv_path                  = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.kv_version               = 2 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.066s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.namespace                = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.root_token_id            = **** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.ssl_ca_crt_file          = None {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.timeout                  = 60.0 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.use_ssl                  = False {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:22:16 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] ******************************************************************************** {{(pid=72247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 17 05:22:16 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:16 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:16 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:16 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:16 devstack sudo[72357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 17 05:22:16 devstack sudo[72357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:17 devstack sudo[72357]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:17 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:17 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:17 devstack sudo[72393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:22:17 devstack sudo[72393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:17 devstack sudo[72393]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:17 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.496s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:17 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:22:17 devstack cinder-volume[72353]: INFO cinder.brick.local_dev.lvm [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 17 05:22:17 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:17 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:17 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:17 devstack sudo[72641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 17 05:22:17 devstack sudo[72641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:18 devstack sudo[72641]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:18 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:18 devstack cinder-volume[72353]: DEBUG cinder.brick.local_dev.lvm [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72353) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 17 05:22:18 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:18 devstack sudo[72829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:22:18 devstack sudo[72829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:19 devstack sudo[72829]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:19 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.151s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:19 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:19 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:19 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:19 devstack sudo[73004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:22:19 devstack sudo[73004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:20 devstack sudo[73004]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:20 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.827s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:20 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:20 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:20 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:20 devstack sudo[73070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 17 05:22:20 devstack sudo[73070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:20 devstack sudo[73070]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:20 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.588s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:20 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:20 devstack sudo[73100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 17 05:22:20 devstack sudo[73100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:21 devstack sudo[73100]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:21 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:21 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:21 devstack sudo[73108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 17 05:22:21 devstack sudo[73108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:21 devstack sudo[73108]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:21 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:21 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:21 devstack sudo[73111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:22:21 devstack sudo[73111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:22 devstack sudo[73111]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:22 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:22 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:22 devstack sudo[73116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:22:22 devstack sudo[73116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:22 devstack sudo[73116]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:22 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:22 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:22 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:22 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:22 devstack sudo[73120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:22:22 devstack sudo[73120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:23 devstack sudo[73120]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:23 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.540s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:23 devstack cinder-volume[72353]: INFO cinder.volume.drivers.lvm [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 17 05:22:23 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:23 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:23 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:23 devstack sudo[73158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:22:23 devstack sudo[73158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:23 devstack sudo[73158]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:23 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:23 devstack cinder-volume[72353]: DEBUG cinder.volume.drivers.lvm [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Updating volume stats {{(pid=72353) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 17 05:22:23 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:23 devstack sudo[73246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 17 05:22:23 devstack sudo[73246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:24 devstack sudo[73246]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:24 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:24 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:24 devstack sudo[73308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:22:24 devstack sudo[73308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:24 devstack sudo[73308]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:24 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:24 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:24 devstack sudo[73389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:22:24 devstack sudo[73389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:25 devstack sudo[73389]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:25 devstack sudo[73395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:22:25 devstack sudo[73395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:25 devstack sudo[73395]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:25 devstack cinder-volume[72353]: INFO cinder.volume.driver [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Driver hasn't implemented _init_vendor_properties()
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG cinder.volume.driver [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72353) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG oslo_db.sqlalchemy.engines [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72353) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG dbcounter [-] [72353] Writer thread running {{(pid=72353) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG cinder.db.sqlalchemy.api [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Building query based on filter {{(pid=72353) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG cinder.image.image_utils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72353) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 17 05:22:25 devstack cinder-volume[72353]: INFO cinder.keymgr.migration [None req-86b5ed0e-ff70-4e50-a411-ebfb82836472 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG cinder.volume.drivers.lvm [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Updating volume stats {{(pid=72353) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:25 devstack sudo[73400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 17 05:22:25 devstack sudo[73400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:25 devstack sudo[73400]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:25 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:26 devstack sudo[73404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:22:26 devstack sudo[73404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:26 devstack cinder-volume[72247]: DEBUG dbcounter [-] [72247] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72247) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:22:26 devstack sudo[73404]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:26 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:26 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:26 devstack sudo[73408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:22:26 devstack sudo[73408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:26 devstack sudo[73408]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:26 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:26 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:26 devstack sudo[73417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:22:26 devstack sudo[73417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:27 devstack sudo[73417]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:27 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:27 devstack cinder-volume[72353]: DEBUG cinder.manager [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Notifying Schedulers of capabilities ... {{(pid=72353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:22:27 devstack cinder-volume[72353]: INFO cinder.volume.manager [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Driver initialization completed successfully.
Apr 17 05:22:27 devstack cinder-volume[72353]: INFO cinder.manager [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Initiating service 2 cleanup
Apr 17 05:22:27 devstack cinder-volume[72353]: INFO cinder.manager [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Service 2 cleanup completed.
Apr 17 05:22:27 devstack cinder-volume[72353]: DEBUG cinder.service [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Creating RPC server for service cinder-volume {{(pid=72353) start /opt/stack/cinder/cinder/service.py:231}}
Apr 17 05:22:27 devstack cinder-volume[72353]: DEBUG cinder.service [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72353) start /opt/stack/cinder/cinder/service.py:237}}
Apr 17 05:22:27 devstack cinder-volume[72353]: INFO cinder.volume.manager [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 17 05:22:27 devstack cinder-volume[72353]: DEBUG cinder.volume.drivers.lvm [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Updating volume stats {{(pid=72353) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 17 05:22:27 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:27 devstack sudo[73421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 17 05:22:27 devstack sudo[73421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:28 devstack sudo[73421]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:28 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:28 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:28 devstack sudo[73424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:22:28 devstack sudo[73424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:28 devstack sudo[73424]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:28 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:28 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:28 devstack sudo[73481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:22:28 devstack sudo[73481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:29 devstack sudo[73481]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:22:29 devstack sudo[73544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:22:29 devstack sudo[73544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:22:29 devstack sudo[73544]: pam_unix(sudo:session): session closed for user root
Apr 17 05:22:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:22:29 devstack cinder-volume[72353]: INFO cinder.volume.manager [None req-b75ea066-68c2-479e-956d-f5ea8935e1dd None None] Driver post RPC initialization completed successfully.
Apr 17 05:22:37 devstack cinder-volume[72353]: DEBUG dbcounter [-] [72353] Writing DB stats cinder:SELECT=3 {{(pid=72353) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:22:39 devstack cinder-volume[72353]: DEBUG dbcounter [-] [72353] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72353) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:23:29 devstack cinder-volume[72353]: DEBUG oslo_service.periodic_task [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72353) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:23:29 devstack cinder-volume[72353]: DEBUG cinder.volume.drivers.lvm [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Updating volume stats {{(pid=72353) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 17 05:23:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:23:29 devstack sudo[78220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 17 05:23:29 devstack sudo[78220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:23:29 devstack sudo[78220]: pam_unix(sudo:session): session closed for user root
Apr 17 05:23:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:23:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:23:29 devstack sudo[78223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:23:29 devstack sudo[78223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:23:30 devstack sudo[78223]: pam_unix(sudo:session): session closed for user root
Apr 17 05:23:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:23:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:23:30 devstack sudo[78226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:23:30 devstack sudo[78226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:23:30 devstack sudo[78226]: pam_unix(sudo:session): session closed for user root
Apr 17 05:23:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:23:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:23:30 devstack sudo[78229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:23:30 devstack sudo[78229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:23:31 devstack sudo[78229]: pam_unix(sudo:session): session closed for user root
Apr 17 05:23:31 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:23:31 devstack cinder-volume[72353]: DEBUG cinder.manager [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Notifying Schedulers of capabilities ... {{(pid=72353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:24:29 devstack cinder-volume[72353]: DEBUG oslo_service.periodic_task [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72353) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:24:29 devstack cinder-volume[72353]: DEBUG cinder.volume.drivers.lvm [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Updating volume stats {{(pid=72353) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 17 05:24:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:24:29 devstack sudo[79362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 17 05:24:29 devstack sudo[79362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:24:29 devstack sudo[79362]: pam_unix(sudo:session): session closed for user root
Apr 17 05:24:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:24:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:24:29 devstack sudo[79378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:24:29 devstack sudo[79378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:24:30 devstack sudo[79378]: pam_unix(sudo:session): session closed for user root
Apr 17 05:24:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:24:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:24:30 devstack sudo[79389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:24:30 devstack sudo[79389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:24:30 devstack sudo[79389]: pam_unix(sudo:session): session closed for user root
Apr 17 05:24:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.471s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:24:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:24:30 devstack sudo[79420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:24:30 devstack sudo[79420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:24:31 devstack sudo[79420]: pam_unix(sudo:session): session closed for user root
Apr 17 05:24:31 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:24:31 devstack cinder-volume[72353]: DEBUG cinder.manager [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Notifying Schedulers of capabilities ... {{(pid=72353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:24:39 devstack cinder-volume[72353]: DEBUG dbcounter [-] [72353] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72353) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:25:29 devstack cinder-volume[72353]: DEBUG oslo_service.periodic_task [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72353) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:25:29 devstack cinder-volume[72353]: DEBUG cinder.volume.drivers.lvm [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Updating volume stats {{(pid=72353) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 17 05:25:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:25:29 devstack sudo[81206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 17 05:25:29 devstack sudo[81206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:25:29 devstack sudo[81206]: pam_unix(sudo:session): session closed for user root
Apr 17 05:25:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:25:29 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:25:29 devstack sudo[81210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:25:29 devstack sudo[81210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:25:30 devstack sudo[81210]: pam_unix(sudo:session): session closed for user root
Apr 17 05:25:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:25:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:25:30 devstack sudo[81223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 17 05:25:30 devstack sudo[81223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:25:30 devstack sudo[81223]: pam_unix(sudo:session): session closed for user root
Apr 17 05:25:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.414s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:25:30 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:25:30 devstack sudo[81227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 17 05:25:30 devstack sudo[81227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:25:31 devstack sudo[81227]: pam_unix(sudo:session): session closed for user root
Apr 17 05:25:31 devstack cinder-volume[72353]: DEBUG oslo_concurrency.processutils [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72353) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:25:31 devstack cinder-volume[72353]: DEBUG cinder.manager [None req-ae0f5532-a1b2-4012-935f-5e43115e3bea None None] Notifying Schedulers of capabilities ... {{(pid=72353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:25:46 devstack cinder-volume[72247]: INFO oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Caught SIGTERM, stopping children
Apr 17 05:25:46 devstack cinder-volume[72247]: DEBUG oslo_concurrency.lockutils [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Acquiring lock "singleton_lock" {{(pid=72247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 17 05:25:46 devstack cinder-volume[72247]: DEBUG oslo_concurrency.lockutils [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Acquired lock "singleton_lock" {{(pid=72247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 17 05:25:46 devstack cinder-volume[72247]: DEBUG oslo_concurrency.lockutils [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Releasing lock "singleton_lock" {{(pid=72247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 17 05:25:46 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Stop services. {{(pid=72247) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 17 05:25:46 devstack cinder-volume[72247]: DEBUG oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Killing children. {{(pid=72247) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 17 05:25:46 devstack cinder-volume[72247]: INFO oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Waiting on 1 children to exit
Apr 17 05:25:47 devstack cinder-volume[72353]: DEBUG oslo_concurrency.lockutils [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Acquiring lock "singleton_lock" {{(pid=72353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 17 05:25:47 devstack cinder-volume[72353]: DEBUG oslo_concurrency.lockutils [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Acquired lock "singleton_lock" {{(pid=72353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 17 05:25:47 devstack cinder-volume[72353]: DEBUG oslo_concurrency.lockutils [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Releasing lock "singleton_lock" {{(pid=72353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 17 05:25:47 devstack cinder-volume[72353]: WARNING amqp [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 17 05:25:47 devstack cinder-volume[72353]: WARNING amqp [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 17 05:25:47 devstack cinder-volume[72247]: INFO oslo_service.backend._eventlet.service [None req-eaa576b4-c671-4305-b95e-d4ec1f13b8ab None None] Child 72353 exited with status 0
Apr 17 05:25:47 devstack cinder-volume[81695]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 17 05:25:47 devstack cinder-volume[81695]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 17 05:25:47 devstack cinder-volume[81695]: we strongly recommend against using it for new projects.
Apr 17 05:25:47 devstack cinder-volume[81695]: If you are already using Eventlet, we recommend migrating to a different
Apr 17 05:25:47 devstack cinder-volume[81695]: framework.  For more detail see
Apr 17 05:25:47 devstack cinder-volume[81695]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 17 05:25:47 devstack cinder-volume[81695]:   import eventlet  # noqa
Apr 17 05:25:49 devstack cinder-volume[81695]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 17 05:25:49 devstack cinder-volume[81695]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 17 05:25:49 devstack cinder-volume[81695]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 17 05:25:50 devstack cinder-volume[81695]: INFO dbcounter [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Registered counter for database cinder
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_db.sqlalchemy.engines [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81695) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG dbcounter [-] [81695] Writer thread running {{(pid=81695) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 17 05:25:50 devstack cinder-volume[81695]: INFO cinder.rpc [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 17 05:25:50 devstack cinder-volume[81695]: INFO cinder.rpc [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_db.sqlalchemy.engines [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81695) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:25:50 devstack cinder-volume[81695]: INFO cinder.volume.manager [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Determined volume DB was empty at startup.
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG cinder.volume.manager [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81695) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 17 05:25:50 devstack cinder-volume[81695]: INFO cinder.volume.manager [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 17 05:25:50 devstack cinder-volume[81695]: WARNING stevedore.named [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 17 05:25:50 devstack cinder-volume[81695]: WARNING castellan.key_manager [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 17 05:25:50 devstack cinder-volume[81695]: WARNING cinder.keymgr.conf_key_mgr [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 17 05:25:50 devstack cinder-volume[81695]: INFO cinder.volume.manager [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_db.sqlalchemy.engines [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81695) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:25:50 devstack cinder-volume[81695]: INFO oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Starting 1 workers
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Started child 81812 {{(pid=81695) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Full set of CONF: {{(pid=81695) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] ******************************************************************************** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Configuration options gathered from: {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 17 05:25:50 devstack cinder-volume[81812]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] ================================================================================ {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] allow_availability_zone_fallback = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] allow_compression_on_image_upload = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] allowed_direct_url_schemes     = [] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] api_rate_limit                 = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] auth_strategy                  = keystone {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_availability_zone      = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_host                   = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_name                   = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_stats_polling_interval = 60 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backup_api_class               = cinder.backup.api.API {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backup_name_template           = backup-%s {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backup_use_same_host           = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backup_use_temp_snapshot       = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] chap_password                  = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] chap_username                  =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cinder_internal_tenant_project_id = 6ed9d3130403400b8fdf7a18be60ac22 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cinder_internal_tenant_user_id = 9e1e4c30b3de41c4bd7666ef782d2a77 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cluster                        = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] compression_format             = gzip {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] config_dir                     = [] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] config_source                  = [] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] control_exchange               = openstack {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] debug                          = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] default_availability_zone      = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] default_group_type             = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] default_volume_type            = QuobyteHD {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] disk_geometry                  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] driver_client_cert             = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] driver_client_cert_key         = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] driver_data_namespace          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] driver_ssl_cert_path           = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] driver_ssl_cert_verify         = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] driver_use_ssl                 = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] enable_new_services            = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] enable_unsupported_driver      = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] enforce_multipath_for_image_xfer = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] filter_function                = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance_api_insecure            = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance_api_servers             = ['http://192.168.122.226/image'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance_api_ssl_compression     = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance_ca_certificates_file    = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance_certfile                = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance_keyfile                 = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance_num_retries             = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81812) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance_request_timeout         = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] goodness_function              = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] graceful_shutdown_timeout      = 5 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] group_api_class                = cinder.group.api.API {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] host                           = devstack {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] image_compress_on_upload       = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] image_conversion_address_space_limit = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] image_conversion_cpu_limit     = 60 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] image_conversion_disable       = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] image_upload_use_cinder_backend = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] image_upload_use_internal_tenant = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] image_volume_cache_enabled     = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] image_volume_cache_max_count   = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] image_volume_cache_max_size_gb = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] init_host_max_objects_retrieval = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] iscsi_target_flags             =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] iscsi_write_cache              = on {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] iser_helper                    = tgtadm {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] iser_ip_address                = 192.168.122.226 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] iser_port                      = 3260 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] log_color                      = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] log_config_append              = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] log_dir                        = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] log_file                       = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] log_options                    = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] log_rotate_interval            = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] log_rotate_interval_type       = days {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] log_rotation_type              = none {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] max_age                        = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] max_logfile_count              = 30 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] max_logfile_size_mb            = 200 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] max_over_subscription_ratio    = 20.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] message_reap_interval          = 86400 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] message_ttl                    = 2592000 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] migration_create_volume_timeout_secs = 300 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] monkey_patch                   = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] monkey_patch_modules           = [] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] my_ip                          = 192.168.122.226 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] no_snapshot_gb_quota           = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] num_iser_scan_tries            = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] num_shell_tries                = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] num_volume_device_scan_tries   = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] nvmeof_conn_info_version       = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] nvmet_ns_id                    = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] nvmet_port_id                  = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] osapi_max_limit                = 1000 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] osapi_volume_ext_list          = [] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] osapi_volume_listen_port       = 8776 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] osapi_volume_use_ssl           = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] osapi_volume_workers           = 2 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] per_volume_size_limit          = -1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] periodic_fuzzy_delay           = 60 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] periodic_interval              = 60 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] public_endpoint                = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] publish_errors                 = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] quota_backup_gigabytes         = 1000 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] quota_backups                  = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] quota_gigabytes                = 1000 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] quota_groups                   = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] quota_snapshots                = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] quota_volumes                  = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] rate_limit_burst               = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] rate_limit_except_level        = CRITICAL {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] rate_limit_interval            = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] reinit_driver_count            = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] replication_device             = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] report_discard_supported       = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] report_interval                = 120 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] reservation_clean_interval     = 86400 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] reservation_expire             = 86400 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] reserved_image_namespaces      = [] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] reserved_percentage            = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] rpc_response_timeout           = 120 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] run_external_periodic_tasks    = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] scst_target_driver             = iscsi {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] scst_target_iqn_name           = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_down_time              = 720 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] shell_completion               = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] snapshot_name_template         = snapshot-%s {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] split_loggers                  = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] state_path                     = /opt/stack/data/cinder {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] storage_availability_zone      = nova {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] storage_protocol               = iSCSI {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] syslog_log_facility            = LOG_USER {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] target_helper                  = lioadm {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] target_ip_address              = 192.168.122.226 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] target_port                    = 3260 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] target_protocol                = iscsi {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] target_secondary_ip_addresses  = [] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] trace_flags                    = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] transport_url                  = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] until_refresh                  = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] use_chap_auth                  = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] use_default_quota_class        = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] use_journal                    = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] use_json                       = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] use_multipath_for_image_xfer   = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] use_stderr                     = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] use_syslog                     = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] verify_glance_signatures       = enabled {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_api_class               = cinder.volume.api.API {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_backend_name            = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_clear                   = zero {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_clear_ionice            = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81812) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 17 05:25:50 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 17 05:25:50 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_clear_size              = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_copy_bps_limit          = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Running cmd (subprocess): mount.quobyte {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_dd_blocksize            = 1M {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_name_template           = volume-%s {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_service_inithost_offload = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volume_usage_audit_period      = month {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] zoning_mode                    = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_concurrency.disable_process_locking = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.admin_password = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.admin_token = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.admin_user  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.auth_protocol = https {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.auth_section = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.auth_type   = password {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.auth_uri    = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.auth_version = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.cache       = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.certfile    = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.identity_uri = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.include_service_catalog = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.insecure    = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.interface   = public {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.keyfile     = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_password =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcache_username =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.region_name = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.service_type = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.226/identity {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.backend                  = dogpile.cache.null {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.backend_argument         = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.backend_expiration_time  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.config_prefix            = cache.oslo {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.debug_cache_backend      = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.enable_retry_client      = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.enable_socket_keepalive  = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.enabled                  = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.enforce_fips_mode        = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.expiration_time          = 600 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.hashclient_retry_attempts = 2 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.memcache_dead_retry      = 300 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.memcache_sasl_enabled    = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.password                 = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.proxies                  = [] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.redis_db                 = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.redis_server             = localhost:6379 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.retry_attempts           = 2 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.retry_delay              = 0.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.socket_keepalive_count   = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.socket_keepalive_idle    = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.socket_keepalive_interval = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.socket_timeout           = 1.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.tls_allowed_ciphers      = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.tls_cafile               = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.tls_certfile             = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.tls_enabled              = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.tls_keyfile              = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cache.username                 = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] coordination.backend_url       = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.asyncio_connection    = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.asyncio_slave_connection = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.backend               = sqlalchemy {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.connection            = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.connection_debug      = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.connection_parameters =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.connection_recycle_time = 3600 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.connection_trace      = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.db_inc_retry_interval = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.db_max_retries        = 20 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.db_max_retry_interval = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.db_retry_interval     = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.max_overflow          = 50 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.max_pool_size         = 5 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.max_retries           = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.mysql_wsrep_sync_wait = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.pool_timeout          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.retry_interval        = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.slave_connection      = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.sqlite_synchronous    = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.synchronous_reader    = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] database.use_db_reconnect      = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.connection_string     = messaging:// {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.enabled               = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.es_doc_type           = notification {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.es_scroll_size        = 10000 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.es_scroll_time        = 2m {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.filter_error_trace    = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.hmac_keys             = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.sentinel_service_name = mymaster {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.socket_timeout        = 0.1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.trace_requests        = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler.trace_sqlalchemy      = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler_jaeger.process_tags   = {} {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler_jaeger.service_name_prefix = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] profiler_otlp.service_name_prefix = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.enforce_new_defaults = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: WARNING oslo_config.cfg [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.enforce_scope      = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.policy_default_rule = default {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] privsep_osbrick.group          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack quobyte-client[81813]: Reading configuration file: /etc/quobyte/client.cfg
Apr 17 05:25:50 devstack quobyte-client[81813]: Invalid parameters found, error: missing mount point.
Apr 17 05:25:50 devstack quobyte-client[81813]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 17 05:25:50 devstack quobyte-client[81813]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] privsep_osbrick.helper_command = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] privsep_osbrick.user           = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cinder_sys_admin.group         = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cinder_sys_admin.helper_command = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] cinder_sys_admin.user          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_user.auth_section      = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_user.auth_type         = password {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_user.cafile            = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_user.certfile          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_user.collect_timing    = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_user.insecure          = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_user.keyfile           = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_user.send_service_user_token = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_user.split_loggers     = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] service_user.timeout           = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance.auth_section            = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance.auth_type               = password {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance.certfile                = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance.collect_timing          = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance.insecure                = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance.keyfile                 = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance.region_name             = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance.split_loggers           = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] glance.timeout                 = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.backend_availability_zone = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81812]: INFO cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 ...
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 -c /etc/quobyte/client-cinder.cfg {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.chap_password = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.chap_username =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.disk_geometry = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.driver_client_cert = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.driver_client_cert_key = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.driver_data_namespace = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.driver_use_ssl = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.extra_capabilities = {} {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.filter_function = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.goodness_function = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.iscsi_target_flags =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.iscsi_write_cache = on {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.iser_port     = 3260 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nas_host      =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nas_login     = admin {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nas_mount_options = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nas_password  = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nas_private_key =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nas_share_path =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.num_shell_tries = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack sudo[81814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 -c /etc/quobyte/client-cinder.cfg
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack sudo[81814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.quobyte_volume_url = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.replication_device = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.report_discard_supported = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.reserved_percentage = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.target_helper = tgtadm {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.target_port   = 3260 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.target_protocol = iscsi {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.trace_flags   = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.unique_fqdn_network = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.use_chap_auth = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.volume_backend_name = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.volume_clear  = zero {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.volume_clear_ionice = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.volume_clear_size = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_reports.file_event_handler = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_reports.log_dir           = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.backend_availability_zone = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.backend_host         = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.chap_password        = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.chap_username        = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.disk_geometry        = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.driver_client_cert   = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.driver_data_namespace = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.extra_capabilities   = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.filter_function      = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.goodness_function    = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.iser_helper          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.iser_ip_address      = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.iser_port            = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nas_host             = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nas_login            = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nas_mount_options    = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nas_password         = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nas_private_key      = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nas_share_path       = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.num_shell_tries      = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.replication_device   = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.report_discard_supported = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.reserved_percentage  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.scst_target_driver   = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.storage_protocol     = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.target_helper        = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.target_ip_address    = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.target_port          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.target_prefix        = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.target_protocol      = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.trace_flags          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.use_chap_auth        = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.volume_clear         = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.volume_clear_size    = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] QuobyteHD.volumes_dir          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:50 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_notifications.driver = [] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_notifications.retry = -1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] key_manager.fixed_key          = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.barbican_api_version  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.barbican_endpoint     = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.barbican_endpoint_type = public {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.barbican_region_name  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.cafile                = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.certfile              = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.collect_timing        = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.insecure              = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.keyfile               = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.number_of_retries     = 60 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.retry_delay           = 1 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.send_service_user_token = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.split_loggers         = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.timeout               = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.verify_ssl            = True {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican.verify_ssl_path       = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican_service_user.auth_section = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican_service_user.auth_type = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican_service_user.cafile   = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican_service_user.certfile = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican_service_user.collect_timing = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican_service_user.insecure = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican_service_user.keyfile  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican_service_user.split_loggers = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] barbican_service_user.timeout  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.approle_role_id          = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.approle_secret_id        = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.kv_mountpoint            = secret {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.kv_path                  = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.kv_version               = 2 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.namespace                = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.root_token_id            = **** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.ssl_ca_crt_file          = None {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.timeout                  = 60.0 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.use_ssl                  = False {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:25:51 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] ******************************************************************************** {{(pid=81695) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 17 05:25:51 devstack sudo[81814]: pam_unix(sudo:session): session closed for user root
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.511s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:25:51 devstack cinder-volume[81812]: INFO cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 succeeded
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.535s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:25:51 devstack sudo[81883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:25:51 devstack sudo[81883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:25:51 devstack sudo[81883]: pam_unix(sudo:session): session closed for user root
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.392s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:25:51 devstack cinder-volume[81812]: INFO cinder.volume.driver [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Driver hasn't implemented _init_vendor_properties()
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG cinder.volume.driver [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81812) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG oslo_db.sqlalchemy.engines [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81812) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writer thread running {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG cinder.db.sqlalchemy.api [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Building query based on filter {{(pid=81812) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81812) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 17 05:25:51 devstack cinder-volume[81812]: INFO cinder.keymgr.migration [None req-acdc8a25-5ea3-4442-86c4-17174f9931b9 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:25:51 devstack sudo[81886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:25:51 devstack sudo[81886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:25:52 devstack sudo[81886]: pam_unix(sudo:session): session closed for user root
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.381s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:25:52 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Driver initialization completed successfully.
Apr 17 05:25:52 devstack cinder-volume[81812]: INFO cinder.manager [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Initiating service 3 cleanup
Apr 17 05:25:52 devstack cinder-volume[81812]: INFO cinder.manager [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Service 3 cleanup completed.
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG cinder.service [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Creating RPC server for service cinder-volume {{(pid=81812) start /opt/stack/cinder/cinder/service.py:231}}
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG cinder.service [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81812) start /opt/stack/cinder/cinder/service.py:237}}
Apr 17 05:25:52 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:25:52 devstack sudo[81891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:25:52 devstack sudo[81891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:25:52 devstack sudo[81891]: pam_unix(sudo:session): session closed for user root
Apr 17 05:25:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.400s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:25:52 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-41551e20-fe62-4753-96ef-fc861fe5c138 None None] Driver post RPC initialization completed successfully.
Apr 17 05:25:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-77a8b00b-1537-4e78-b114-3b12efe263b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:25:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-77a8b00b-1537-4e78-b114-3b12efe263b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:25:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-77a8b00b-1537-4e78-b114-3b12efe263b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:25:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-77a8b00b-1537-4e78-b114-3b12efe263b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:25:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-77a8b00b-1537-4e78-b114-3b12efe263b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:25:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-77a8b00b-1537-4e78-b114-3b12efe263b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:25:55 devstack sudo[81958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:25:55 devstack sudo[81958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:25:56 devstack sudo[81958]: pam_unix(sudo:session): session closed for user root
Apr 17 05:25:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-77a8b00b-1537-4e78-b114-3b12efe263b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.385s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:25:56 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-77a8b00b-1537-4e78-b114-3b12efe263b9 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:25:59 devstack cinder-volume[81695]: INFO oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Caught SIGTERM, stopping children
Apr 17 05:25:59 devstack cinder-volume[81695]: DEBUG oslo_concurrency.lockutils [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Acquiring lock "singleton_lock" {{(pid=81695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 17 05:25:59 devstack cinder-volume[81695]: DEBUG oslo_concurrency.lockutils [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Acquired lock "singleton_lock" {{(pid=81695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 17 05:25:59 devstack cinder-volume[81695]: DEBUG oslo_concurrency.lockutils [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Releasing lock "singleton_lock" {{(pid=81695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 17 05:25:59 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Stop services. {{(pid=81695) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 17 05:25:59 devstack cinder-volume[81695]: DEBUG oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Killing children. {{(pid=81695) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 17 05:25:59 devstack cinder-volume[81695]: INFO oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Waiting on 1 children to exit
Apr 17 05:26:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Acquiring lock "singleton_lock" {{(pid=81812) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 17 05:26:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Acquired lock "singleton_lock" {{(pid=81812) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 17 05:26:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Releasing lock "singleton_lock" {{(pid=81812) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 17 05:26:00 devstack cinder-volume[81812]: WARNING amqp [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 17 05:26:00 devstack cinder-volume[81812]: WARNING amqp [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 17 05:26:00 devstack cinder-volume[81695]: INFO oslo_service.backend._eventlet.service [None req-57fae316-c638-4c97-83bd-8709f0d34f49 None None] Child 81812 exited with status 0
Apr 17 05:26:01 devstack cinder-volume[82034]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 17 05:26:01 devstack cinder-volume[82034]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 17 05:26:01 devstack cinder-volume[82034]: we strongly recommend against using it for new projects.
Apr 17 05:26:01 devstack cinder-volume[82034]: If you are already using Eventlet, we recommend migrating to a different
Apr 17 05:26:01 devstack cinder-volume[82034]: framework.  For more detail see
Apr 17 05:26:01 devstack cinder-volume[82034]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 17 05:26:01 devstack cinder-volume[82034]:   import eventlet  # noqa
Apr 17 05:26:02 devstack cinder-volume[82034]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82034) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 17 05:26:02 devstack cinder-volume[82034]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82034) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 17 05:26:02 devstack cinder-volume[82034]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82034) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 17 05:26:03 devstack cinder-volume[82034]: INFO dbcounter [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Registered counter for database cinder
Apr 17 05:26:03 devstack cinder-volume[82034]: DEBUG oslo_db.sqlalchemy.engines [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:26:03 devstack cinder-volume[82034]: DEBUG dbcounter [-] [82034] Writer thread running {{(pid=82034) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 17 05:26:03 devstack cinder-volume[82034]: INFO cinder.rpc [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 17 05:26:03 devstack cinder-volume[82034]: INFO cinder.rpc [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 17 05:26:03 devstack cinder-volume[82034]: DEBUG oslo_db.sqlalchemy.engines [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:26:03 devstack cinder-volume[82034]: INFO cinder.volume.manager [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Determined volume DB was empty at startup.
Apr 17 05:26:03 devstack cinder-volume[82034]: DEBUG cinder.volume.manager [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82034) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 17 05:26:03 devstack cinder-volume[82034]: WARNING stevedore.named [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 17 05:26:03 devstack cinder-volume[82034]: WARNING castellan.key_manager [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 17 05:26:03 devstack cinder-volume[82034]: WARNING cinder.keymgr.conf_key_mgr [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 17 05:26:03 devstack cinder-volume[82034]: INFO cinder.volume.manager [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_db.sqlalchemy.engines [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:26:04 devstack cinder-volume[82034]: INFO oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Starting 1 workers
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Started child 82266 {{(pid=82034) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Full set of CONF: {{(pid=82034) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] ******************************************************************************** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Configuration options gathered from: {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] ================================================================================ {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] allow_availability_zone_fallback = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82266]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] allow_compression_on_image_upload = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] allowed_direct_url_schemes     = [] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] api_rate_limit                 = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] auth_strategy                  = keystone {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_availability_zone      = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_host                   = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_name                   = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_stats_polling_interval = 60 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backup_api_class               = cinder.backup.api.API {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backup_name_template           = backup-%s {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backup_use_same_host           = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backup_use_temp_snapshot       = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] chap_password                  = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] chap_username                  =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cinder_internal_tenant_project_id = 6ed9d3130403400b8fdf7a18be60ac22 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cinder_internal_tenant_user_id = 9e1e4c30b3de41c4bd7666ef782d2a77 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cluster                        = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] compression_format             = gzip {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] config_dir                     = [] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] config_source                  = [] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] control_exchange               = openstack {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] debug                          = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] default_availability_zone      = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] default_group_type             = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] default_volume_type            = QuobyteHD {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] disk_geometry                  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] driver_client_cert             = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] driver_client_cert_key         = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] driver_data_namespace          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] driver_ssl_cert_path           = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] driver_ssl_cert_verify         = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] driver_use_ssl                 = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] enable_new_services            = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] enable_unsupported_driver      = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] enforce_multipath_for_image_xfer = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] filter_function                = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance_api_insecure            = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance_api_servers             = ['http://192.168.122.226/image'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance_api_ssl_compression     = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance_ca_certificates_file    = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance_certfile                = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance_keyfile                 = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance_num_retries             = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance_request_timeout         = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] goodness_function              = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] graceful_shutdown_timeout      = 5 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] group_api_class                = cinder.group.api.API {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] host                           = devstack {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] image_compress_on_upload       = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] image_conversion_address_space_limit = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82266) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] image_conversion_cpu_limit     = 60 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] image_conversion_disable       = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] image_upload_use_cinder_backend = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] image_upload_use_internal_tenant = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] image_volume_cache_enabled     = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] image_volume_cache_max_count   = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] image_volume_cache_max_size_gb = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] init_host_max_objects_retrieval = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] iscsi_target_flags             =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] iscsi_write_cache              = on {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] iser_helper                    = tgtadm {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] iser_ip_address                = 192.168.122.226 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] iser_port                      = 3260 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] log_color                      = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] log_config_append              = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] log_dir                        = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] log_file                       = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] log_options                    = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] log_rotate_interval            = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] log_rotate_interval_type       = days {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] log_rotation_type              = none {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] max_age                        = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] max_logfile_count              = 30 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] max_logfile_size_mb            = 200 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] max_over_subscription_ratio    = 20.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] message_reap_interval          = 86400 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] message_ttl                    = 2592000 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] migration_create_volume_timeout_secs = 300 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] monkey_patch                   = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] monkey_patch_modules           = [] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] my_ip                          = 192.168.122.226 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] no_snapshot_gb_quota           = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] num_iser_scan_tries            = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] num_shell_tries                = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] num_volume_device_scan_tries   = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] nvmeof_conn_info_version       = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] nvmet_ns_id                    = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] nvmet_port_id                  = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] osapi_max_limit                = 1000 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] osapi_volume_ext_list          = [] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] osapi_volume_listen_port       = 8776 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] osapi_volume_use_ssl           = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] osapi_volume_workers           = 2 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] per_volume_size_limit          = -1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] periodic_fuzzy_delay           = 60 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] periodic_interval              = 60 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] public_endpoint                = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] publish_errors                 = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] quota_backup_gigabytes         = 1000 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] quota_backups                  = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] quota_gigabytes                = 1000 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] quota_groups                   = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] quota_snapshots                = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] quota_volumes                  = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] rate_limit_burst               = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] rate_limit_except_level        = CRITICAL {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] rate_limit_interval            = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] reinit_driver_count            = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] replication_device             = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] report_discard_supported       = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] report_interval                = 120 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] reservation_clean_interval     = 86400 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] reservation_expire             = 86400 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] reserved_image_namespaces      = [] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] reserved_percentage            = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] rpc_response_timeout           = 120 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] run_external_periodic_tasks    = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] scst_target_driver             = iscsi {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] scst_target_iqn_name           = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_down_time              = 720 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] shell_completion               = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] snapshot_name_template         = snapshot-%s {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] split_loggers                  = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] state_path                     = /opt/stack/data/cinder {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] storage_availability_zone      = nova {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] storage_protocol               = iSCSI {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] syslog_log_facility            = LOG_USER {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] target_helper                  = lioadm {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] target_ip_address              = 192.168.122.226 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] target_port                    = 3260 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] target_protocol                = iscsi {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] target_secondary_ip_addresses  = [] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] trace_flags                    = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] transport_url                  = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] until_refresh                  = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] use_chap_auth                  = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] use_default_quota_class        = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] use_journal                    = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] use_json                       = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] use_multipath_for_image_xfer   = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] use_stderr                     = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] use_syslog                     = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] verify_glance_signatures       = enabled {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_api_class               = cinder.volume.api.API {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_backend_name            = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_clear                   = zero {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_clear_ionice            = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_clear_size              = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_copy_bps_limit          = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_dd_blocksize            = 1M {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_name_template           = volume-%s {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_service_inithost_offload = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volume_usage_audit_period      = month {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] zoning_mode                    = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_concurrency.disable_process_locking = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.admin_password = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.admin_token = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.admin_user  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.auth_protocol = https {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.auth_section = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.auth_type   = password {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.auth_uri    = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.auth_version = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.cache       = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.certfile    = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.identity_uri = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.include_service_catalog = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.insecure    = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.interface   = public {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.keyfile     = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_password =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcache_username =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.region_name = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.service_type = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.226/identity {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.backend                  = dogpile.cache.null {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.backend_argument         = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.backend_expiration_time  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.config_prefix            = cache.oslo {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.debug_cache_backend      = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.enable_retry_client      = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.enable_socket_keepalive  = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.enabled                  = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.enforce_fips_mode        = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.expiration_time          = 600 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.hashclient_retry_attempts = 2 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.memcache_dead_retry      = 300 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.memcache_sasl_enabled    = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.password                 = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.proxies                  = [] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.redis_db                 = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.redis_server             = localhost:6379 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.retry_attempts           = 2 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.retry_delay              = 0.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.socket_keepalive_count   = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.socket_keepalive_idle    = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.socket_keepalive_interval = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.socket_timeout           = 1.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.tls_allowed_ciphers      = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.tls_cafile               = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.tls_certfile             = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.tls_enabled              = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.tls_keyfile              = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cache.username                 = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] coordination.backend_url       = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.asyncio_connection    = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.asyncio_slave_connection = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.backend               = sqlalchemy {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.connection            = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.connection_debug      = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.connection_parameters =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.connection_recycle_time = 3600 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.connection_trace      = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.db_inc_retry_interval = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.db_max_retries        = 20 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.db_max_retry_interval = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.db_retry_interval     = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.max_overflow          = 50 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.max_pool_size         = 5 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.max_retries           = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.mysql_wsrep_sync_wait = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.pool_timeout          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.retry_interval        = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.slave_connection      = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.sqlite_synchronous    = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.synchronous_reader    = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] database.use_db_reconnect      = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.connection_string     = messaging:// {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.enabled               = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.es_doc_type           = notification {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.es_scroll_size        = 10000 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.es_scroll_time        = 2m {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.filter_error_trace    = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.hmac_keys             = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.sentinel_service_name = mymaster {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.socket_timeout        = 0.1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.trace_requests        = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler.trace_sqlalchemy      = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler_jaeger.process_tags   = {} {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler_jaeger.service_name_prefix = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] profiler_otlp.service_name_prefix = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.enforce_new_defaults = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: WARNING oslo_config.cfg [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.enforce_scope      = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.policy_default_rule = default {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] privsep_osbrick.group          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] privsep_osbrick.helper_command = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] privsep_osbrick.user           = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cinder_sys_admin.group         = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cinder_sys_admin.helper_command = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] cinder_sys_admin.user          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_user.auth_section      = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_user.auth_type         = password {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_user.cafile            = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_user.certfile          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_user.collect_timing    = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_user.insecure          = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_user.keyfile           = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_user.send_service_user_token = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_user.split_loggers     = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] service_user.timeout           = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance.auth_section            = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance.auth_type               = password {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance.certfile                = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance.collect_timing          = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance.insecure                = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance.keyfile                 = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance.region_name             = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance.split_loggers           = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] glance.timeout                 = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.backend_availability_zone = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.chap_password = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.chap_username =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.disk_geometry = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.driver_client_cert = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.driver_client_cert_key = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.driver_data_namespace = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.driver_use_ssl = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.extra_capabilities = {} {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.filter_function = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.goodness_function = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.iscsi_target_flags =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82266) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.iscsi_write_cache = on {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.quobyte [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.quobyte [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.iser_port     = 3260 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nas_host      =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nas_login     = admin {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nas_mount_options = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Running cmd (subprocess): mount.quobyte {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nas_password  = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nas_private_key =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nas_share_path =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.num_shell_tries = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.quobyte_volume_url = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.replication_device = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.report_discard_supported = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.reserved_percentage = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.target_helper = tgtadm {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.target_port   = 3260 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.target_protocol = iscsi {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.trace_flags   = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.unique_fqdn_network = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.use_chap_auth = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.volume_backend_name = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.volume_clear  = zero {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.volume_clear_ionice = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.volume_clear_size = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_reports.file_event_handler = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_reports.log_dir           = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.backend_availability_zone = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack quobyte-client[82293]: Reading configuration file: /etc/quobyte/client.cfg
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.backend_host         = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.chap_password        = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.chap_username        = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.disk_geometry        = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack quobyte-client[82293]: Invalid parameters found, error: missing mount point.
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.driver_client_cert   = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.driver_data_namespace = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack quobyte-client[82293]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.extra_capabilities   = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.filter_function      = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.goodness_function    = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack quobyte-client[82293]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.iser_helper          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.iser_ip_address      = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.iser_port            = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nas_host             = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nas_login            = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nas_mount_options    = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nas_password         = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nas_private_key      = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nas_share_path       = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.num_shell_tries      = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.replication_device   = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.report_discard_supported = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.reserved_percentage  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.scst_target_driver   = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.storage_protocol     = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.target_helper        = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.target_ip_address    = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.target_port          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.target_prefix        = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.target_protocol      = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.trace_flags          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.use_chap_auth        = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.volume_clear         = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.volume_clear_size    = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] QuobyteHD.volumes_dir          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_notifications.driver = [] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_notifications.retry = -1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] key_manager.fixed_key          = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.barbican_api_version  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.barbican_endpoint     = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.barbican_endpoint_type = public {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.barbican_region_name  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.cafile                = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.certfile              = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.collect_timing        = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.insecure              = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.keyfile               = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.number_of_retries     = 60 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.retry_delay           = 1 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.send_service_user_token = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.split_loggers         = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.timeout               = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.verify_ssl            = True {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican.verify_ssl_path       = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican_service_user.auth_section = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican_service_user.auth_type = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican_service_user.cafile   = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican_service_user.certfile = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican_service_user.collect_timing = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican_service_user.insecure = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican_service_user.keyfile  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican_service_user.split_loggers = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] barbican_service_user.timeout  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.approle_role_id          = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.approle_secret_id        = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.kv_mountpoint            = secret {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.kv_path                  = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.kv_version               = 2 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.namespace                = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.root_token_id            = **** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.ssl_ca_crt_file          = None {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.timeout                  = 60.0 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.use_ssl                  = False {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 17 05:26:04 devstack cinder-volume[82034]: DEBUG oslo_service.backend._eventlet.service [None req-46b8d834-d4f7-444f-97cb-8dbdba3888d5 None None] ******************************************************************************** {{(pid=82034) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] CMD "mount.quobyte" returned: 1 in 0.138s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:26:04 devstack sudo[82296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:26:04 devstack sudo[82296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:26:04 devstack sudo[82296]: pam_unix(sudo:session): session closed for user root
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.396s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:26:04 devstack cinder-volume[82266]: INFO cinder.volume.driver [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Driver hasn't implemented _init_vendor_properties()
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG cinder.volume.driver [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82266) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_db.sqlalchemy.engines [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82266) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writer thread running {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG cinder.db.sqlalchemy.api [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Building query based on filter {{(pid=82266) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82266) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:26:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:26:04 devstack cinder-volume[82266]: INFO cinder.keymgr.migration [None req-b8b10b2a-7d1c-4b6a-9da4-dc716b2c6410 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 17 05:26:04 devstack sudo[82312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:26:04 devstack sudo[82312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:26:05 devstack sudo[82312]: pam_unix(sudo:session): session closed for user root
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.411s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:26:05 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Driver initialization completed successfully.
Apr 17 05:26:05 devstack cinder-volume[82266]: INFO cinder.manager [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Initiating service 3 cleanup
Apr 17 05:26:05 devstack cinder-volume[82266]: INFO cinder.manager [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Service 3 cleanup completed.
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG cinder.service [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Creating RPC server for service cinder-volume {{(pid=82266) start /opt/stack/cinder/cinder/service.py:231}}
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG cinder.service [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82266) start /opt/stack/cinder/cinder/service.py:237}}
Apr 17 05:26:05 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:26:05 devstack sudo[82316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:26:05 devstack sudo[82316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:26:05 devstack sudo[82316]: pam_unix(sudo:session): session closed for user root
Apr 17 05:26:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.402s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:26:05 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ab2b727a-0d10-482d-8993-06b708d84c2c None None] Driver post RPC initialization completed successfully.
Apr 17 05:26:14 devstack cinder-volume[82034]: DEBUG dbcounter [-] [82034] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82034) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:26:15 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:26:15 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=2 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Flow 'volume_create_manager' (b0accba5-dd10-40eb-909c-c937435321b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455edde8-9700-4c05-bead-818e0d15879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455edde8-9700-4c05-bead-818e0d15879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-994677939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cddd52e-838c-4dea-9a42-0f1ff748c754,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70e17ce5ff7d424fa7f1fec0a3ded165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:05Z,use_quota=True,user_id='f27c4360e554480f9efbfc87f2d03abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72e1b55-710a-4e75-92fd-37f5691a23f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72e1b55-710a-4e75-92fd-37f5691a23f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e8b9a3-83c9-4b23-aa15-b8bc1b38e592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e8b9a3-83c9-4b23-aa15-b8bc1b38e592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cddd52e-838c-4dea-9a42-0f1ff748c754', 'volume_name': 'volume-4cddd52e-838c-4dea-9a42-0f1ff748c754', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3669992c-87af-4d0d-a32f-5af18799ded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3669992c-87af-4d0d-a32f-5af18799ded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0524bc-7906-4fd4-aa5a-c0d4744df3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:04 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Volume 4cddd52e-838c-4dea-9a42-0f1ff748c754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cddd52e-838c-4dea-9a42-0f1ff748c754', 'volume_size': 1}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-994677939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cddd52e-838c-4dea-9a42-0f1ff748c754,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70e17ce5ff7d424fa7f1fec0a3ded165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:05Z,use_quota=True,user_id='f27c4360e554480f9efbfc87f2d03abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Creating volume 4cddd52e-838c-4dea-9a42-0f1ff748c754 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:27:04 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:27:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:04 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e1b2e2fe-a7e3-477d-801c-ba9ac1c9cbe6 tempest-GroupSnapshotsV319Test-348078538 None] Group tempest-GroupSnapshotsV319Test-Group-2025733354: creating
Apr 17 05:27:04 devstack sudo[82668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754 1073741824
Apr 17 05:27:04 devstack sudo[82668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:04 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e1b2e2fe-a7e3-477d-801c-ba9ac1c9cbe6 tempest-GroupSnapshotsV319Test-348078538 None] Group tempest-GroupSnapshotsV319Test-Group-2025733354: created successfully
Apr 17 05:27:04 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e1b2e2fe-a7e3-477d-801c-ba9ac1c9cbe6 tempest-GroupSnapshotsV319Test-348078538 None] Create group completed successfully.
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Flow 'volume_create_manager' (42afac33-09d7-4972-b92d-758b2224e2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71068b24-1f36-489a-8627-c3c38eb1f714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71068b24-1f36-489a-8627-c3c38eb1f714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1403735495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a935d5bb49e4659a23a9688be9452ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:05Z,use_quota=True,user_id='30c527de0a4443018868f592610d6c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbd2a76-bc46-476e-a5bd-11295c1ab133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbd2a76-bc46-476e-a5bd-11295c1ab133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a41ab2d-974c-44e5-8146-b5b5215288d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a41ab2d-974c-44e5-8146-b5b5215288d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c', 'volume_name': 'volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3d1b96-da88-4db8-8b28-ab19e3affa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3d1b96-da88-4db8-8b28-ab19e3affa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39aa86f2-4e8a-402f-8385-d991e85b1ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:05 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Volume ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c', 'volume_size': 1}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:05 devstack sudo[82668]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754 1073741824" returned: 0 in 0.577s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:05 devstack sudo[82988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754
Apr 17 05:27:05 devstack sudo[82988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:06 devstack sudo[82988]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754" returned: 0 in 0.569s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.717s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1403735495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a935d5bb49e4659a23a9688be9452ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:05Z,use_quota=True,user_id='30c527de0a4443018868f592610d6c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Creating volume ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:27:06 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0524bc-7906-4fd4-aa5a-c0d4744df3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cddd52e-838c-4dea-9a42-0f1ff748c754', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a336536e-1128-4456-80e1-08457cb8d98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:06 devstack sudo[82992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c 1073741824
Apr 17 05:27:06 devstack sudo[82992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:06 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Volume volume-4cddd52e-838c-4dea-9a42-0f1ff748c754 (4cddd52e-838c-4dea-9a42-0f1ff748c754): created successfully
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a336536e-1128-4456-80e1-08457cb8d98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Flow 'volume_create_manager' (b0accba5-dd10-40eb-909c-c937435321b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Flow 'volume_create_manager' (2cf4215e-2669-4616-aa28-1a71ea90e7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f577f94d-7566-48f3-a32f-96153fba4218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-28c8326a-63bb-4f79-a2fc-f454f3278411 req-c6febcc8-31a0-4012-a513-48ffc649e7e3 tempest-VolumesGetTestJSON-1620409164 None] Created volume successfully.
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f577f94d-7566-48f3-a32f-96153fba4218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1902335270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=25f7ec51-dc64-4926-83d9-90a421f511f3,host='devstack@QuobyteHD#QuobyteHD',id=fefc8026-4e71-40b7-b06a-1e65b7f5376e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd9b98fa46d41feaf312e36eaa7f153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:06Z,use_quota=True,user_id='310e107e7219491c8110b0df678a5cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b4415bc-407e-4d43-bd58-ab12fa9ab01b),volume_type_id=3b4415bc-407e-4d43-bd58-ab12fa9ab01b)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce225084-044e-43e3-9c97-081dc2806864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce225084-044e-43e3-9c97-081dc2806864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e50530c-1246-423e-95b0-1e1db9404628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e50530c-1246-423e-95b0-1e1db9404628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fefc8026-4e71-40b7-b06a-1e65b7f5376e', 'volume_name': 'volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a3a7f0-ebdb-425c-9bec-82e78b93ca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a3a7f0-ebdb-425c-9bec-82e78b93ca6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31bae124-5d01-4826-af71-6d2768db1753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:06 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Volume fefc8026-4e71-40b7-b06a-1e65b7f5376e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e', 'volume_size': 1}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Acquiring lock "cinder-4cddd52e-838c-4dea-9a42-0f1ff748c754-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Lock "cinder-4cddd52e-838c-4dea-9a42-0f1ff748c754-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Acquiring lock "cinder-quobyte-4cddd52e-838c-4dea-9a42-0f1ff748c754" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Lock "cinder-quobyte-4cddd52e-838c-4dea-9a42-0f1ff748c754" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:06 devstack cinder-volume[82266]: INFO oslo.privsep.daemon [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp72s01r2y/privsep.sock']
Apr 17 05:27:06 devstack sudo[82998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp72s01r2y/privsep.sock
Apr 17 05:27:06 devstack sudo[82998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:06 devstack sudo[82992]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c 1073741824" returned: 0 in 0.660s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:06 devstack sudo[83000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c
Apr 17 05:27:06 devstack sudo[83000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 17 05:27:07 devstack sudo[83000]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c" returned: 0 in 0.517s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.059s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=25f7ec51-dc64-4926-83d9-90a421f511f3,created_at=2026-04-17T03:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1902335270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=25f7ec51-dc64-4926-83d9-90a421f511f3,host='devstack@QuobyteHD#QuobyteHD',id=fefc8026-4e71-40b7-b06a-1e65b7f5376e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd9b98fa46d41feaf312e36eaa7f153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:06Z,use_quota=True,user_id='310e107e7219491c8110b0df678a5cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b4415bc-407e-4d43-bd58-ab12fa9ab01b),volume_type_id=3b4415bc-407e-4d43-bd58-ab12fa9ab01b)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Creating volume fefc8026-4e71-40b7-b06a-1e65b7f5376e {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:27:07 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39aa86f2-4e8a-402f-8385-d991e85b1ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63de04b4-2f06-4e40-a999-aec4967038d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:07 devstack sudo[83009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e 1073741824
Apr 17 05:27:07 devstack sudo[83009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:07 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Volume volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c (ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c): created successfully
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63de04b4-2f06-4e40-a999-aec4967038d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Flow 'volume_create_manager' (42afac33-09d7-4972-b92d-758b2224e2eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:07 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-100ea3ee-830e-4cdb-86ce-558a25367087 tempest-VolumesAdminNegativeTest-644569452 None] Created volume successfully.
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 17 05:27:07 devstack cinder-volume[82266]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 17 05:27:07 devstack sudo[83009]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e 1073741824" returned: 0 in 0.513s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:07 devstack sudo[83016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e
Apr 17 05:27:07 devstack sudo[83016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:07 devstack sudo[82998]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:07 devstack cinder-volume[82266]: INFO oslo.privsep.daemon [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Spawned new privsep daemon via rootwrap
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Accepted privsep connection to /tmp/tmp72s01r2y/privsep.sock {{(pid=82266) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 17 05:27:07 devstack cinder-volume[82266]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 17 05:27:07 devstack cinder-volume[82266]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 17 05:27:07 devstack cinder-volume[82266]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 17 05:27:07 devstack cinder-volume[82266]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83012
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa378401-0ae4-470e-ad10-ccf789f4617b]: (2,) {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8e5c72-f62d-4f68-898a-71ae4d0532e6]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:07 devstack sudo[83021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754
Apr 17 05:27:07 devstack sudo[83021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Acquiring lock "cinder-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Lock "cinder-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Acquiring lock "cinder-quobyte-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Lock "cinder-quobyte-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca66aab4-1a26-495c-887e-12d3f2b8eb1c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:08 devstack sudo[83025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c
Apr 17 05:27:08 devstack sudo[83025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:08 devstack sudo[83016]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e" returned: 0 in 0.625s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31bae124-5d01-4826-af71-6d2768db1753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a31ecf4-6cea-4b6c-b909-f8d6d65da264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:08 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Volume volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e (fefc8026-4e71-40b7-b06a-1e65b7f5376e): created successfully
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a31ecf4-6cea-4b6c-b909-f8d6d65da264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Flow 'volume_create_manager' (2cf4215e-2669-4616-aa28-1a71ea90e7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:08 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3fc4fe8b-0a82-46b9-aba6-eb09d7ab3d85 tempest-GroupSnapshotsV319Test-348078538 None] Created volume successfully.
Apr 17 05:27:08 devstack sudo[83021]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754" returned: 0 in 0.623s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:08 devstack sudo[83033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754
Apr 17 05:27:08 devstack sudo[83033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:09 devstack sudo[83025]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c" returned: 0 in 0.858s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:09 devstack sudo[83033]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4cddd52e-838c-4dea-9a42-0f1ff748c754" returned: 0 in 0.694s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Lock "cinder-quobyte-4cddd52e-838c-4dea-9a42-0f1ff748c754" released by "delete_volume" :: held 2.543s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:09 devstack sudo[83068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c
Apr 17 05:27:09 devstack sudo[83068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:09 devstack cinder-volume[82266]: WARNING cinder.quota [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:27:09 devstack cinder-volume[82266]: WARNING cinder.quota [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG cinder.quota [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Created reservations ['496f0c15-c9c0-40a8-aec3-6f475fc6f747', '0858f9e7-d318-4592-8435-02c7def5d3f4', '4e00faf6-533e-402a-8569-25b79e724fc0', 'd238a243-e726-4840-a963-38c8d95d01e5'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:09 devstack sudo[83071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:27:09 devstack sudo[83071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:09 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] GroupSnapshot 4e2205da-88a2-4c27-8b43-6551f7dc629b: creating.
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Group snapshot 4e2205da-88a2-4c27-8b43-6551f7dc629b: creating. {{(pid=82266) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Creating offline snapshot bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 of volume fefc8026-4e71-40b7-b06a-1e65b7f5376e {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeed12db-76c8-4cde-8112-436f20f9b1a2]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:10 devstack sudo[83068]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c" returned: 0 in 0.955s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Lock "cinder-quobyte-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c" released by "delete_volume" :: held 1.844s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:10 devstack sudo[83079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e
Apr 17 05:27:10 devstack sudo[83079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:10 devstack sudo[83071]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Created reservations ['01ea4b5d-9955-4034-9b74-870c5a1879b8', '18ca898e-6526-4cf3-9fea-28c37e58a8b0', 'a92f5f06-edc4-43c9-87fb-be6c92fa3905', 'b958ec0e-3ab3-4c5b-9fa5-1eae459f3887'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.743s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG cinder.manager [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:27:10 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Deleted volume successfully.
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-9f176f2d-b042-4712-8144-77d01b3de51f req-810b1cb9-5fcf-446d-8db6-366f0b995062 tempest-VolumesGetTestJSON-1620409164 None] Lock "cinder-4cddd52e-838c-4dea-9a42-0f1ff748c754-delete_volume" released by "delete_volume" :: held 3.599s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:10 devstack sudo[83082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:27:10 devstack sudo[83082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:11 devstack sudo[83079]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e" returned: 0 in 1.223s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:11 devstack sudo[83094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 1G
Apr 17 05:27:11 devstack sudo[83094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:11 devstack sudo[83082]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 1.347s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:11 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:27:11 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Deleted volume successfully.
Apr 17 05:27:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1eace501-2d9c-4f41-aadd-21fd0af98aa5 tempest-VolumesAdminNegativeTest-644569452 None] Lock "cinder-ee8ca22d-b4dc-4dd2-85f8-22ac919cc50c-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:12 devstack sudo[83094]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 1G" returned: 0 in 1.040s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:12 devstack sudo[83125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6
Apr 17 05:27:12 devstack sudo[83125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:12 devstack sudo[83125]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6" returned: 0 in 0.699s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:12 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:27:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:12 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:27:13 devstack sudo[83132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6
Apr 17 05:27:13 devstack sudo[83132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Flow 'volume_create_manager' (bd18ef9a-7d3b-49ba-aedd-92d8d2a90215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca558e40-354b-4904-bb36-30b7d4469621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca558e40-354b-4904-bb36-30b7d4469621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-175520933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd56d76354e84a24af07ad0338158df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:13Z,use_quota=True,user_id='c5172b7c439442f18365313cb74cdc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4175cf47-a6f9-4a5e-9504-4709ca46ea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4175cf47-a6f9-4a5e-9504-4709ca46ea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a80c7b-00c3-4811-b311-8474ed79bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a80c7b-00c3-4811-b311-8474ed79bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1', 'volume_name': 'volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b24fac1-12e2-43bf-b2c6-e7607261e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b24fac1-12e2-43bf-b2c6-e7607261e44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97119b1-5af6-45ff-991a-abc6633575f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:13 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Volume c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1', 'volume_size': 1}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:13 devstack sudo[83132]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6" returned: 0 in 0.544s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:13 devstack sudo[83138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.info
Apr 17 05:27:13 devstack sudo[83138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Flow 'volume_create_manager' (50d3d247-d841-4aa5-a11b-3b8e02eb23f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdec25c-4530-4075-a46c-b9320796b1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdec25c-4530-4075-a46c-b9320796b1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1734051121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb609fab-bc78-4488-a19d-8e478771295c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78448560aa0242afa5faac1df299940d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:14Z,use_quota=True,user_id='775106a8fa0c4bca93368f7d3ac94af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226fd36e-ed34-4798-9a9f-2411ad0c554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226fd36e-ed34-4798-9a9f-2411ad0c554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adc695d-59d8-4121-b194-cfc5d5cd8307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adc695d-59d8-4121-b194-cfc5d5cd8307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb609fab-bc78-4488-a19d-8e478771295c', 'volume_name': 'volume-eb609fab-bc78-4488-a19d-8e478771295c', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8246905d-1c34-4c94-bc51-224206baf2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8246905d-1c34-4c94-bc51-224206baf2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f19d09-f9d4-4adb-9af1-ce4084a3a820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:13 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Volume eb609fab-bc78-4488-a19d-8e478771295c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb609fab-bc78-4488-a19d-8e478771295c', 'volume_size': 1}
Apr 17 05:27:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:14 devstack sudo[83138]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.info" returned: 0 in 0.510s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:14 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:14 devstack sudo[83143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.info
Apr 17 05:27:14 devstack sudo[83143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:14 devstack sudo[83143]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.info" returned: 0 in 0.431s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.572s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.403s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-175520933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd56d76354e84a24af07ad0338158df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:13Z,use_quota=True,user_id='c5172b7c439442f18365313cb74cdc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Creating volume c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:27:14 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:27:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:14 devstack sudo[83147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1 1073741824
Apr 17 05:27:14 devstack sudo[83147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5d3d0d8e-0412-4cbe-a0d1-36e46d732eae tempest-GroupSnapshotsV319Test-348078538 None] group_snapshot 4e2205da-88a2-4c27-8b43-6551f7dc629b: created successfully
Apr 17 05:27:15 devstack sudo[83147]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1 1073741824" returned: 0 in 0.519s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:15 devstack sudo[83152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1
Apr 17 05:27:15 devstack sudo[83152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] group_snapshot 4e2205da-88a2-4c27-8b43-6551f7dc629b: deleting
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] group_snapshot 4e2205da-88a2-4c27-8b43-6551f7dc629b: deleting {{(pid=82266) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Acquiring lock "cinder-quobyte-fefc8026-4e71-40b7-b06a-1e65b7f5376e" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Lock "cinder-quobyte-fefc8026-4e71-40b7-b06a-1e65b7f5376e" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Acquiring lock "cinder-quobyte-bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Lock "cinder-quobyte-bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Deleting offline snapshot bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 of volume fefc8026-4e71-40b7-b06a-1e65b7f5376e {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] snapshot_file for this snap is: volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a71ba18-ecb5-4e18-b106-bf9abe3e32fa]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:15 devstack sudo[83152]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1" returned: 0 in 0.609s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.747s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1734051121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb609fab-bc78-4488-a19d-8e478771295c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78448560aa0242afa5faac1df299940d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:14Z,use_quota=True,user_id='775106a8fa0c4bca93368f7d3ac94af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Creating volume eb609fab-bc78-4488-a19d-8e478771295c {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:27:15 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:15 devstack sudo[83156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6
Apr 17 05:27:15 devstack sudo[83156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97119b1-5af6-45ff-991a-abc6633575f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:15 devstack sudo[83157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c 1073741824
Apr 17 05:27:15 devstack sudo[83157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c5a2cc-90b2-44aa-97b6-daaa7931b854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:15 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Volume volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1 (c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1): created successfully
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c5a2cc-90b2-44aa-97b6-daaa7931b854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Flow 'volume_create_manager' (bd18ef9a-7d3b-49ba-aedd-92d8d2a90215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-01d1509b-0e2b-4965-8b4d-1dee3f7d91a0 tempest-DeleteServersTestJSON-1158552607 None] Created volume successfully.
Apr 17 05:27:16 devstack sudo[83156]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6" returned: 0 in 0.560s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[51da46be-fee1-4564-adc0-743a3673b664]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:16 devstack sudo[83157]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c 1073741824" returned: 0 in 0.544s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:16 devstack sudo[83166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e
Apr 17 05:27:16 devstack sudo[83167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c
Apr 17 05:27:16 devstack sudo[83167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:16 devstack sudo[83166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:16 devstack sudo[83167]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c" returned: 0 in 0.441s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f19d09-f9d4-4adb-9af1-ce4084a3a820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb609fab-bc78-4488-a19d-8e478771295c', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1301c8e6-9627-4c21-8e53-7a00660236bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:16 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Volume volume-eb609fab-bc78-4488-a19d-8e478771295c (eb609fab-bc78-4488-a19d-8e478771295c): created successfully
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1301c8e6-9627-4c21-8e53-7a00660236bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Flow 'volume_create_manager' (50d3d247-d841-4aa5-a11b-3b8e02eb23f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:16 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-cf246baa-577d-4c50-be0f-dfdb766c154c tempest-VolumesTestJSON-1631330094 None] Created volume successfully.
Apr 17 05:27:16 devstack sudo[83166]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e" returned: 0 in 0.568s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:16 devstack sudo[83180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6
Apr 17 05:27:16 devstack sudo[83180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:17 devstack sudo[83180]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6" returned: 0 in 0.631s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:17 devstack sudo[83186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6
Apr 17 05:27:17 devstack sudo[83186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Flow 'volume_create_manager' (7f3a4f5a-2736-4b4c-8b0e-750f2cb37622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfceb3f-7f65-4360-8993-684ef6aa11fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfceb3f-7f65-4360-8993-684ef6aa11fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1259828330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e792e09a-0085-497a-984b-6b4fd33f46cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78448560aa0242afa5faac1df299940d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:17Z,use_quota=True,user_id='775106a8fa0c4bca93368f7d3ac94af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca325b4-6754-46b4-b21d-d2d97e12afdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca325b4-6754-46b4-b21d-d2d97e12afdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0593c0c8-39d2-43ca-bcb3-81c5c4cca388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0593c0c8-39d2-43ca-bcb3-81c5c4cca388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e792e09a-0085-497a-984b-6b4fd33f46cc', 'volume_name': 'volume-e792e09a-0085-497a-984b-6b4fd33f46cc', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a944bdc-6837-4623-a858-df597c3fb294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a944bdc-6837-4623-a858-df597c3fb294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dad74b-4382-4df2-aa91-618fada9aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:17 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Volume e792e09a-0085-497a-984b-6b4fd33f46cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e792e09a-0085-497a-984b-6b4fd33f46cc', 'volume_size': 1}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1259828330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e792e09a-0085-497a-984b-6b4fd33f46cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78448560aa0242afa5faac1df299940d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:17Z,use_quota=True,user_id='775106a8fa0c4bca93368f7d3ac94af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Creating volume e792e09a-0085-497a-984b-6b4fd33f46cc {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:27:17 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:17 devstack sudo[83188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc 1073741824
Apr 17 05:27:17 devstack sudo[83188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:17 devstack sudo[83186]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e.bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6" returned: 0 in 0.444s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Lock "cinder-quobyte-bd2418e6-04c9-4ebc-82b3-b7d42ce1a6c6" released by "_delete_snapshot" :: held 2.256s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Lock "cinder-quobyte-fefc8026-4e71-40b7-b06a-1e65b7f5376e" released by "delete_snapshot" :: held 2.268s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:17 devstack cinder-volume[82266]: WARNING cinder.quota [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-803355774 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-803355774, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:27:17 devstack cinder-volume[82266]: WARNING cinder.quota [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-803355774 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-803355774, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:27:17 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] Created reservations ['2837a669-e9f1-4882-9231-3f43ead9feaa', '34355923-12ad-4531-9469-1734085d1d10', 'ef1b4540-e9fb-4b88-8b7c-c1f5a70a861b', '3e22bed9-201d-480e-8811-0f6c180a87e0'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:17 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-2fbad537-1555-4fa0-852e-68f1f098790e tempest-GroupSnapshotsV319Test-348078538 None] group_snapshot 4e2205da-88a2-4c27-8b43-6551f7dc629b: deleted successfully
Apr 17 05:27:18 devstack sudo[83188]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc 1073741824" returned: 0 in 0.556s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:18 devstack sudo[83194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc
Apr 17 05:27:18 devstack sudo[83194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:18 devstack sudo[83194]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc" returned: 0 in 0.429s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:27:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dad74b-4382-4df2-aa91-618fada9aa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e792e09a-0085-497a-984b-6b4fd33f46cc', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac8e08f-d8ea-43c8-b386-45627fa3408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:18 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Volume volume-e792e09a-0085-497a-984b-6b4fd33f46cc (e792e09a-0085-497a-984b-6b4fd33f46cc): created successfully
Apr 17 05:27:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac8e08f-d8ea-43c8-b386-45627fa3408f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Flow 'volume_create_manager' (7f3a4f5a-2736-4b4c-8b0e-750f2cb37622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:18 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-cf937e3a-3883-4378-a1c4-ed99d006f643 tempest-VolumesTestJSON-1631330094 None] Created volume successfully.
Apr 17 05:27:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Acquiring lock "cinder-quobyte-fefc8026-4e71-40b7-b06a-1e65b7f5376e" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Lock "cinder-quobyte-fefc8026-4e71-40b7-b06a-1e65b7f5376e" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:19 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1e9e5e-32c7-433f-ba97-038e007ea5b3]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:19 devstack sudo[83198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e
Apr 17 05:27:19 devstack sudo[83198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:19 devstack sudo[83198]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e" returned: 0 in 0.604s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:19 devstack sudo[83207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e
Apr 17 05:27:19 devstack sudo[83207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:20 devstack sudo[83207]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fefc8026-4e71-40b7-b06a-1e65b7f5376e" returned: 0 in 0.478s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Flow 'volume_create_manager' (e544fd90-7121-4668-92eb-d707d655f3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0520d62b-037d-47ac-ba54-b9232d47fdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Lock "cinder-quobyte-fefc8026-4e71-40b7-b06a-1e65b7f5376e" released by "delete_volume" :: held 1.154s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0520d62b-037d-47ac-ba54-b9232d47fdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-846260148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c6ed55-fbf8-4ed1-985a-854835cbb306,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78448560aa0242afa5faac1df299940d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:20Z,use_quota=True,user_id='775106a8fa0c4bca93368f7d3ac94af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483ab4c7-4b07-4db4-9260-18b86dfb927b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483ab4c7-4b07-4db4-9260-18b86dfb927b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775440e1-0b38-44f0-aedf-824aab00d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775440e1-0b38-44f0-aedf-824aab00d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c6ed55-fbf8-4ed1-985a-854835cbb306', 'volume_name': 'volume-04c6ed55-fbf8-4ed1-985a-854835cbb306', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff0af49-1c66-4804-a46c-e07bb58a1e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff0af49-1c66-4804-a46c-e07bb58a1e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50001900-20d5-4d9e-b690-ebc26640d3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:20 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Volume 04c6ed55-fbf8-4ed1-985a-854835cbb306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c6ed55-fbf8-4ed1-985a-854835cbb306', 'volume_size': 1}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-846260148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c6ed55-fbf8-4ed1-985a-854835cbb306,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78448560aa0242afa5faac1df299940d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:20Z,use_quota=True,user_id='775106a8fa0c4bca93368f7d3ac94af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Creating volume 04c6ed55-fbf8-4ed1-985a-854835cbb306 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:27:20 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:20 devstack sudo[83211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306 1073741824
Apr 17 05:27:20 devstack sudo[83211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Created reservations ['6f729d94-e1b7-4102-ad71-6ef1bcfdec73'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:20 devstack cinder-volume[82266]: WARNING cinder.quota [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-803355774 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-803355774, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Created reservations ['92b7a2ef-a709-4f1a-8060-84238bff8b82', 'ec5c9c0c-eb16-4841-8559-a9d152dcf2ee', 'b56f2a2e-fff6-4afd-a06d-4fd3d469f5a9', '6ecb6abb-9195-4839-9f62-96624eb85a78'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:20 devstack sudo[83213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:27:20 devstack sudo[83213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:21 devstack sudo[83211]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306 1073741824" returned: 0 in 0.941s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:21 devstack sudo[83213]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.847s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:27:21 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-bc1bf410-5ef1-4f19-a29c-d114ea1256c5 tempest-GroupSnapshotsV319Test-348078538 None] Delete group completed successfully.
Apr 17 05:27:21 devstack sudo[83222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306
Apr 17 05:27:21 devstack sudo[83222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:21 devstack cinder-volume[82266]: WARNING py.warnings [req-d5a8bf36-69ad-4b26-97e3-015cc629d188 req-c1b2b989-3ba2-4122-b13f-4f6fdda35647 tempest-DeleteServersTestJSON-1158552607 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Apr 17 05:27:21 devstack cinder-volume[82266]:   .first()
Apr 17 05:27:21 devstack cinder-volume[82266]: 
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-d5a8bf36-69ad-4b26-97e3-015cc629d188 req-c1b2b989-3ba2-4122-b13f-4f6fdda35647 tempest-DeleteServersTestJSON-1158552607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:21 devstack sudo[83222]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306" returned: 0 in 0.750s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-d5a8bf36-69ad-4b26-97e3-015cc629d188 req-c1b2b989-3ba2-4122-b13f-4f6fdda35647 tempest-DeleteServersTestJSON-1158552607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.412s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50001900-20d5-4d9e-b690-ebc26640d3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c6ed55-fbf8-4ed1-985a-854835cbb306', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da6d0a1-1d8e-404d-a36c-287824fd14da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[047ba283-92ac-4358-94af-c9fcfcaa0da1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-d5a8bf36-69ad-4b26-97e3-015cc629d188 req-c1b2b989-3ba2-4122-b13f-4f6fdda35647 tempest-DeleteServersTestJSON-1158552607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:22 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Volume volume-04c6ed55-fbf8-4ed1-985a-854835cbb306 (04c6ed55-fbf8-4ed1-985a-854835cbb306): created successfully
Apr 17 05:27:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da6d0a1-1d8e-404d-a36c-287824fd14da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Flow 'volume_create_manager' (e544fd90-7121-4668-92eb-d707d655f3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:22 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-643bca75-6dec-49db-8449-31870abbbfcb tempest-VolumesTestJSON-1631330094 None] Created volume successfully.
Apr 17 05:27:22 devstack sudo[83236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1
Apr 17 05:27:22 devstack sudo[83236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:23 devstack sudo[83236]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-d5a8bf36-69ad-4b26-97e3-015cc629d188 req-c1b2b989-3ba2-4122-b13f-4f6fdda35647 tempest-DeleteServersTestJSON-1158552607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1" returned: 0 in 1.081s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-d5a8bf36-69ad-4b26-97e3-015cc629d188 req-c1b2b989-3ba2-4122-b13f-4f6fdda35647 tempest-DeleteServersTestJSON-1158552607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.101s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-d5a8bf36-69ad-4b26-97e3-015cc629d188 req-c1b2b989-3ba2-4122-b13f-4f6fdda35647 tempest-DeleteServersTestJSON-1158552607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12', 'name': 'volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0bc5ccb-f6a1-4cdd-8809-73f1ae9bbe5d', 'enforce_multipath': True} {{(pid=82266) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 17 05:27:23 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-d5a8bf36-69ad-4b26-97e3-015cc629d188 req-c1b2b989-3ba2-4122-b13f-4f6fdda35647 tempest-DeleteServersTestJSON-1158552607 None] attachment_update completed successfully.
Apr 17 05:27:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Acquiring lock "cinder-04c6ed55-fbf8-4ed1-985a-854835cbb306-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Lock "cinder-04c6ed55-fbf8-4ed1-985a-854835cbb306-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Acquiring lock "cinder-quobyte-04c6ed55-fbf8-4ed1-985a-854835cbb306" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Lock "cinder-quobyte-04c6ed55-fbf8-4ed1-985a-854835cbb306" acquired by "delete_volume" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:23 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[efac9a17-787e-4421-b6f8-9bee0bd31ee8]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:23 devstack sudo[83242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306
Apr 17 05:27:23 devstack sudo[83242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:24 devstack sudo[83242]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306" returned: 0 in 0.703s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:24 devstack sudo[83315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306
Apr 17 05:27:24 devstack sudo[83315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:24 devstack sudo[83315]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04c6ed55-fbf8-4ed1-985a-854835cbb306" returned: 0 in 0.644s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Lock "cinder-quobyte-04c6ed55-fbf8-4ed1-985a-854835cbb306" released by "delete_volume" :: held 1.383s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Created reservations ['7a50e474-c380-452d-a8aa-5eb2af434d2d', '295ace2f-7014-4465-8fe9-ea2fb28b8f66', 'd72ff9c2-da0f-4c8b-aaee-39f94d846ad5', 'b90201fb-e550-4994-bb25-ac3481c923ee'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:24 devstack sudo[83635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:27:24 devstack sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:25 devstack sudo[83635]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.709s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:25 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:27:25 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Deleted volume successfully.
Apr 17 05:27:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f5dbf625-abda-40a8-93c6-9a22c997fc0e tempest-VolumesTestJSON-1631330094 None] Lock "cinder-04c6ed55-fbf8-4ed1-985a-854835cbb306-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Acquiring lock "cinder-e792e09a-0085-497a-984b-6b4fd33f46cc-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:25 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1dcc363d-209a-474c-a3b0-51885e1af972 tempest-GroupsV320Test-1918361280 None] Group tempest-GroupsV320Test-Group-471821529: creating
Apr 17 05:27:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Lock "cinder-e792e09a-0085-497a-984b-6b4fd33f46cc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:25 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1dcc363d-209a-474c-a3b0-51885e1af972 tempest-GroupsV320Test-1918361280 None] Group tempest-GroupsV320Test-Group-471821529: created successfully
Apr 17 05:27:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Acquiring lock "cinder-quobyte-e792e09a-0085-497a-984b-6b4fd33f46cc" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:25 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1dcc363d-209a-474c-a3b0-51885e1af972 tempest-GroupsV320Test-1918361280 None] Create group completed successfully.
Apr 17 05:27:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Lock "cinder-quobyte-e792e09a-0085-497a-984b-6b4fd33f46cc" acquired by "delete_volume" :: waited 0.014s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:25 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b60d2fe-4fbe-4212-807f-be527f266e74]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:25 devstack sudo[83639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc
Apr 17 05:27:25 devstack sudo[83639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:26 devstack sudo[83639]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc" returned: 0 in 0.608s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:26 devstack sudo[83644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc
Apr 17 05:27:26 devstack sudo[83644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:26 devstack sudo[83644]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e792e09a-0085-497a-984b-6b4fd33f46cc" returned: 0 in 0.429s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Lock "cinder-quobyte-e792e09a-0085-497a-984b-6b4fd33f46cc" released by "delete_volume" :: held 1.073s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Created reservations ['2a3c2061-14ad-44c2-b350-1aac272c1795', '3e3f4c38-828c-4a8f-82ee-c33d8d4fc23d', '8830801f-eaeb-4550-b1bb-2af3c71618ce', '7c4d2bd9-450b-4343-9dac-779fe358994c'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:26 devstack sudo[83648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:27:26 devstack sudo[83648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-bc341bc5-d17c-4847-a747-b7330bbe0eeb tempest-GroupsV320Test-1918361280 None] Created reservations ['5a7ce961-7be4-4586-9644-855508bdcbb0'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc341bc5-d17c-4847-a747-b7330bbe0eeb tempest-GroupsV320Test-1918361280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc341bc5-d17c-4847-a747-b7330bbe0eeb tempest-GroupsV320Test-1918361280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc341bc5-d17c-4847-a747-b7330bbe0eeb tempest-GroupsV320Test-1918361280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc341bc5-d17c-4847-a747-b7330bbe0eeb tempest-GroupsV320Test-1918361280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc341bc5-d17c-4847-a747-b7330bbe0eeb tempest-GroupsV320Test-1918361280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc341bc5-d17c-4847-a747-b7330bbe0eeb tempest-GroupsV320Test-1918361280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:27 devstack sudo[83651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:27:27 devstack sudo[83651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:27 devstack sudo[83648]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.611s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:27:27 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Deleted volume successfully.
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a383e34f-1afd-4ab7-b409-978511344733 tempest-VolumesTestJSON-1631330094 None] Lock "cinder-e792e09a-0085-497a-984b-6b4fd33f46cc-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Acquiring lock "cinder-eb609fab-bc78-4488-a19d-8e478771295c-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Lock "cinder-eb609fab-bc78-4488-a19d-8e478771295c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Acquiring lock "cinder-quobyte-eb609fab-bc78-4488-a19d-8e478771295c" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Lock "cinder-quobyte-eb609fab-bc78-4488-a19d-8e478771295c" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef46230b-de6b-4274-83b6-1ca88c38b80c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:27 devstack sudo[83651]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc341bc5-d17c-4847-a747-b7330bbe0eeb tempest-GroupsV320Test-1918361280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.735s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:27 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-bc341bc5-d17c-4847-a747-b7330bbe0eeb tempest-GroupsV320Test-1918361280 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:27:27 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-bc341bc5-d17c-4847-a747-b7330bbe0eeb tempest-GroupsV320Test-1918361280 None] Delete group completed successfully.
Apr 17 05:27:27 devstack sudo[83656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c
Apr 17 05:27:27 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:28 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c" returned: 0 in 0.550s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:28 devstack sudo[83662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c
Apr 17 05:27:28 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:28 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eb609fab-bc78-4488-a19d-8e478771295c" returned: 0 in 0.487s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Lock "cinder-quobyte-eb609fab-bc78-4488-a19d-8e478771295c" released by "delete_volume" :: held 1.078s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:29 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Created reservations ['e266fdc4-7c3d-4baa-b4b1-e9b6f3bf1fcb', '28aef893-6150-4898-8eaf-e6ed21b8b0e8', 'f782ee22-42c3-4eeb-9881-ced05d32e1a6', '4d474138-03b5-4857-9367-e599c72b3587'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:29 devstack sudo[83666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:27:29 devstack sudo[83666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:29 devstack sudo[83666]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.700s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:29 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:27:29 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Deleted volume successfully.
Apr 17 05:27:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-083148a9-dc64-4398-8d13-cc52ecbb1144 tempest-VolumesTestJSON-1631330094 None] Lock "cinder-eb609fab-bc78-4488-a19d-8e478771295c-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-bf2ba052-f208-4b1e-af37-77fac4d2ba3a req-3eb98b9f-957c-4ec3-a991-2b35e684cfbf tempest-DeleteServersTestJSON-1158552607 None] Terminate volume connection completed successfully.
Apr 17 05:27:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-bf2ba052-f208-4b1e-af37-77fac4d2ba3a req-3eb98b9f-957c-4ec3-a991-2b35e684cfbf tempest-DeleteServersTestJSON-1158552607 None] Deleting attachment d0bc5ccb-f6a1-4cdd-8809-73f1ae9bbe5d. {{(pid=82266) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 17 05:27:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9bc8fb6b-6de6-4c08-9b51-fa9a82038667 tempest-GroupSnapshotsTest-774474103 None] Group tempest-GroupSnapshotsTest-Group-1858131521: creating
Apr 17 05:27:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9bc8fb6b-6de6-4c08-9b51-fa9a82038667 tempest-GroupSnapshotsTest-774474103 None] Group tempest-GroupSnapshotsTest-Group-1858131521: created successfully
Apr 17 05:27:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9bc8fb6b-6de6-4c08-9b51-fa9a82038667 tempest-GroupSnapshotsTest-774474103 None] Create group completed successfully.
Apr 17 05:27:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Acquiring lock "cinder-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Lock "cinder-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Acquiring lock "cinder-quobyte-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Lock "cinder-quobyte-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:36 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc8a2d3-6d79-4fd1-9c5e-d2b339d6d235]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:36 devstack sudo[83729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1
Apr 17 05:27:36 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:37 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1" returned: 0 in 0.552s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:37 devstack sudo[83735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1
Apr 17 05:27:37 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Flow 'volume_create_manager' (4ef57c26-eff5-49fe-93e6-32e7e64151d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b9fa6c-e608-4eb1-9b53-bf3f0d6bc9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b9fa6c-e608-4eb1-9b53-bf3f0d6bc9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2102834272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4ebe63f8-1bc9-4067-bb84-ac3ea08ba9b5,host='devstack@QuobyteHD#QuobyteHD',id=0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e4a249240f47dc9f23ded352235cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:37Z,use_quota=True,user_id='718866c1b0f14268b9b52dfcdc42d4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fe8007d-77d4-4a1b-abc4-22f9e66b1ec7),volume_type_id=8fe8007d-77d4-4a1b-abc4-22f9e66b1ec7)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b05980-a146-4e08-b37e-503775bd1df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b05980-a146-4e08-b37e-503775bd1df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75bcd1f-e254-4587-9f20-a91fb0b6754a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75bcd1f-e254-4587-9f20-a91fb0b6754a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e', 'volume_name': 'volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de7fd7f-6d85-471a-962d-83c75d98a1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de7fd7f-6d85-471a-962d-83c75d98a1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f22d3f-203c-4ca2-9206-98382de46275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:37 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Volume 0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e', 'volume_size': 1}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4ebe63f8-1bc9-4067-bb84-ac3ea08ba9b5,created_at=2026-04-17T03:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2102834272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4ebe63f8-1bc9-4067-bb84-ac3ea08ba9b5,host='devstack@QuobyteHD#QuobyteHD',id=0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e4a249240f47dc9f23ded352235cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:37Z,use_quota=True,user_id='718866c1b0f14268b9b52dfcdc42d4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fe8007d-77d4-4a1b-abc4-22f9e66b1ec7),volume_type_id=8fe8007d-77d4-4a1b-abc4-22f9e66b1ec7)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Creating volume 0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:27:37 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:37 devstack sudo[83737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e 1073741824
Apr 17 05:27:37 devstack sudo[83737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:37 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1" returned: 0 in 0.691s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Lock "cinder-quobyte-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1" released by "delete_volume" :: held 1.270s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Created reservations ['0b375a60-8702-4ba7-b52e-b03e8bd65629', '0cbd6726-b1f0-4943-ab71-683f8496ebf7', 'f9f726db-be0f-4f90-aaed-fbb2406b61c2', 'f397c65d-ebff-4449-bdf5-194d0c52de95'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:37 devstack sudo[83740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:27:37 devstack sudo[83740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Flow 'volume_create_manager' (54f63f2f-b8b6-460c-b4cc-bd80a8f0ce92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799f81cc-df44-4144-bd82-d9bf83291c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799f81cc-df44-4144-bd82-d9bf83291c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-970925265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e809ba47-79df-4c74-a9c3-f9c980168dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e29116cb86134bdcbd0b8e999c2782b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:38Z,use_quota=True,user_id='50cf049e479c42099caba2cb4d9c5929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca829cb-58f6-4ad1-936f-733f80fc871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca829cb-58f6-4ad1-936f-733f80fc871e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d3b610-bb23-4752-b442-cc13a64898d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d3b610-bb23-4752-b442-cc13a64898d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e809ba47-79df-4c74-a9c3-f9c980168dcc', 'volume_name': 'volume-e809ba47-79df-4c74-a9c3-f9c980168dcc', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2773c05-df87-4605-be36-43219a4f684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2773c05-df87-4605-be36-43219a4f684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f34a27f-6b85-4541-b291-331f9bcbe8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:38 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Volume e809ba47-79df-4c74-a9c3-f9c980168dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e809ba47-79df-4c74-a9c3-f9c980168dcc', 'volume_size': 1}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:38 devstack sudo[83737]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e 1073741824" returned: 0 in 0.775s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:38 devstack sudo[83745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e
Apr 17 05:27:38 devstack sudo[83745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:38 devstack sudo[83740]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.718s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:27:38 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Deleted volume successfully.
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d52b064c-2570-47e9-bd50-7ae7641e70b4 tempest-DeleteServersTestJSON-1158552607 None] Lock "cinder-c3a8da6e-4ef9-4f47-8daf-d32211e4a9d1-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:38 devstack sudo[83745]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" returned: 0 in 0.532s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-970925265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e809ba47-79df-4c74-a9c3-f9c980168dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e29116cb86134bdcbd0b8e999c2782b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:27:38Z,use_quota=True,user_id='50cf049e479c42099caba2cb4d9c5929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Creating volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:27:38 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f22d3f-203c-4ca2-9206-98382de46275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db538b6-35e2-411f-afbc-8fbcd94473f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:38 devstack sudo[83749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc 1073741824
Apr 17 05:27:38 devstack sudo[83749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:38 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Volume volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e (0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e): created successfully
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db538b6-35e2-411f-afbc-8fbcd94473f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Flow 'volume_create_manager' (4ef57c26-eff5-49fe-93e6-32e7e64151d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:38 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f555e9d1-92db-4928-bf98-32a581335591 tempest-GroupSnapshotsTest-774474103 None] Created volume successfully.
Apr 17 05:27:39 devstack sudo[83749]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc 1073741824" returned: 0 in 0.583s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:39 devstack sudo[83754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc
Apr 17 05:27:39 devstack sudo[83754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:39 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] GroupSnapshot 4285c887-00e0-4c8c-a333-1812bb6db199: creating.
Apr 17 05:27:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Group snapshot 4285c887-00e0-4c8c-a333-1812bb6db199: creating. {{(pid=82266) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 17 05:27:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:40 devstack sudo[83754]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc" returned: 0 in 0.675s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.245s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Creating offline snapshot f80e6031-a4c8-4769-b0db-49c0bacf687d of volume 0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f34a27f-6b85-4541-b291-331f9bcbe8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e809ba47-79df-4c74-a9c3-f9c980168dcc', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5955d23-602d-4e4a-b70a-d1ef23b1f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3f3309-119b-4b52-94fb-7733f5fa1601]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:40 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Volume volume-e809ba47-79df-4c74-a9c3-f9c980168dcc (e809ba47-79df-4c74-a9c3-f9c980168dcc): created successfully
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5955d23-602d-4e4a-b70a-d1ef23b1f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Flow 'volume_create_manager' (54f63f2f-b8b6-460c-b4cc-bd80a8f0ce92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:27:40 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-605839d0-57fc-490b-8c8b-746f25a65828 tempest-SnapshotsActionsTest-2056862822 None] Created volume successfully.
Apr 17 05:27:40 devstack sudo[83757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e
Apr 17 05:27:40 devstack sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:40 devstack sudo[83757]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" returned: 0 in 0.616s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:40 devstack sudo[83762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d 1G
Apr 17 05:27:40 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:41 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d 1G" returned: 0 in 0.698s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:41 devstack sudo[83773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d
Apr 17 05:27:41 devstack sudo[83773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:42 devstack sudo[83773]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d" returned: 0 in 0.521s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:42 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:27:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:42 devstack sudo[83784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d
Apr 17 05:27:42 devstack sudo[83784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:42 devstack sudo[83784]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d" returned: 0 in 0.501s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:42 devstack sudo[83790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.info
Apr 17 05:27:42 devstack sudo[83790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:43 devstack sudo[83790]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.info" returned: 0 in 0.553s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:43 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:27:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:43 devstack sudo[83794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.info
Apr 17 05:27:43 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:43 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.info" returned: 0 in 0.478s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.458s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.138s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Creating offline snapshot 585b4d77-a7a8-4576-b0ff-42a118e89f4d of volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:27:43 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a149cb9-f761-401a-8e14-00e2b58ddcd1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:43 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a0bea3a2-255e-4752-bcd2-ebe07c98f65d tempest-GroupSnapshotsTest-774474103 None] group_snapshot 4285c887-00e0-4c8c-a333-1812bb6db199: created successfully
Apr 17 05:27:43 devstack sudo[83797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc
Apr 17 05:27:43 devstack sudo[83797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:44 devstack sudo[83797]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc" returned: 0 in 0.615s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:44 devstack sudo[83802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d 1G
Apr 17 05:27:44 devstack sudo[83802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:44 devstack sudo[83802]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d 1G" returned: 0 in 0.566s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:44 devstack sudo[83807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:27:44 devstack sudo[83807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:45 devstack sudo[83807]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 0.538s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:45 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d is being set with open permissions: ugo+rw
Apr 17 05:27:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:45 devstack sudo[83815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:27:45 devstack sudo[83815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:45 devstack sudo[83815]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 0.509s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:45 devstack sudo[83819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.info
Apr 17 05:27:45 devstack sudo[83819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:46 devstack sudo[83819]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.info" returned: 0 in 0.590s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:46 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.info is being set with open permissions: ugo+rw
Apr 17 05:27:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:46 devstack sudo[83828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.info
Apr 17 05:27:46 devstack sudo[83828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:47 devstack sudo[83828]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.info" returned: 0 in 0.602s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.488s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.988s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-f80e6031-a4c8-4769-b0db-49c0bacf687d-0d1aaf9f-b327-4ecb-ab98-72656253fa54" by "_create_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:47 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f710689c-8859-47aa-af5c-95bf494794c7 tempest-SnapshotsActionsTest-2056862822 None] Create snapshot completed successfully
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-f80e6031-a4c8-4769-b0db-49c0bacf687d-0d1aaf9f-b327-4ecb-ab98-72656253fa54" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Creating volume 0d1aaf9f-b327-4ecb-ab98-72656253fa54 from snapshot f80e6031-a4c8-4769-b0db-49c0bacf687d {{(pid=82266) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-0d1aaf9f-b327-4ecb-ab98-72656253fa54" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-0d1aaf9f-b327-4ecb-ab98-72656253fa54" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] snapshot: f80e6031-a4c8-4769-b0db-49c0bacf687d, volume: 0d1aaf9f-b327-4ecb-ab98-72656253fa54,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a42ee8-1ab0-415c-b20c-33c74038c3c5]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:47 devstack sudo[83834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d
Apr 17 05:27:47 devstack sudo[83834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:47 devstack sudo[83834]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d" returned: 0 in 0.792s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0231d1dc-9284-419b-9b16-20647eedc0f2]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:48 devstack sudo[83856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e
Apr 17 05:27:48 devstack sudo[83856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:48 devstack sudo[83856]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" returned: 0 in 0.717s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:48 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54 not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:27:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:48 devstack sudo[83861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54
Apr 17 05:27:48 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:51 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54" returned: 0 in 2.789s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:51 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd57a16-3b6b-4eb4-aab8-902f1b391325]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:51 devstack sudo[83904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e
Apr 17 05:27:51 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:52 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" returned: 0 in 0.802s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e, size 1024.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54 {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:27:52 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Converted 1024.00 MB image at 367.02 MB/s
Apr 17 05:27:52 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54 is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:52 devstack sudo[83910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54
Apr 17 05:27:52 devstack sudo[83910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_service.periodic_task [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:52 devstack sudo[83910]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54" returned: 0 in 0.530s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-0d1aaf9f-b327-4ecb-ab98-72656253fa54" released by "_copy_volume_from_snapshot" :: held 5.699s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-f80e6031-a4c8-4769-b0db-49c0bacf687d-0d1aaf9f-b327-4ecb-ab98-72656253fa54" released by "_create_volume_from_snapshot" :: held 5.729s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.763s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:52 devstack sudo[83915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.638s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:52 devstack sudo[83915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] Creating offline snapshot 2bd287fb-d8f2-4754-a513-6c1c8fbac973 of volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e66f7f-44c7-4987-af9e-756374a05d37]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:53 devstack sudo[83917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:27:53 devstack sudo[83917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:53 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-45d3bf09-7669-47dc-a83c-5dfcd06383af tempest-GroupSnapshotsTest-774474103 None] Create group from source-snapshot-4285c887-00e0-4c8c-a333-1812bb6db199 completed successfully.
Apr 17 05:27:53 devstack sudo[83915]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.506s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:53 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:27:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-0d1aaf9f-b327-4ecb-ab98-72656253fa54" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-0d1aaf9f-b327-4ecb-ab98-72656253fa54" acquired by "delete_volume" :: waited 0.019s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:53 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddaa830-706c-4764-ba8e-44aedaaf600d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:53 devstack sudo[83917]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 0.651s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:27:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:53 devstack sudo[83924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973 1G
Apr 17 05:27:53 devstack sudo[83924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:53 devstack sudo[83923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54
Apr 17 05:27:53 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:54 devstack sudo[83924]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973 1G" returned: 0 in 0.605s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:54 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54" returned: 0 in 0.663s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:54 devstack sudo[83937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973
Apr 17 05:27:54 devstack sudo[83937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:54 devstack sudo[83938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54
Apr 17 05:27:54 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:54 devstack sudo[83937]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973" returned: 0 in 0.512s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:54 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973 is being set with open permissions: ugo+rw
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:54 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0d1aaf9f-b327-4ecb-ab98-72656253fa54" returned: 0 in 0.507s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-0d1aaf9f-b327-4ecb-ab98-72656253fa54" released by "delete_volume" :: held 1.195s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:54 devstack sudo[83947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973
Apr 17 05:27:54 devstack sudo[83947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Created reservations ['9f0f96c0-b5bd-4c57-83ad-984d803af269'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:54 devstack cinder-volume[82266]: WARNING cinder.quota [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1289966788 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1289966788, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:27:54 devstack cinder-volume[82266]: WARNING cinder.quota [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1289966788 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1289966788, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Created reservations ['be133e19-93ee-4b12-a84a-132d14c0fbb6', '7c9200c6-8121-493f-bd5a-2fc4df9645ca', '88e222b8-2bc4-4fcf-9144-b3b11e38b118', '4f2f9f31-1b8c-4b76-aee9-bfcc1e06ea63'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:54 devstack sudo[83949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:27:54 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:55 devstack sudo[83947]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973" returned: 0 in 0.467s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:27:55 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-b5836917-5512-4e6d-b4f3-0957f59df3f2 tempest-SnapshotsActionsTest-2056862822 None] Create snapshot completed successfully
Apr 17 05:27:55 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.487s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:27:55 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-0c736ab8-4143-4fa1-aa44-519efe5dbfee tempest-GroupSnapshotsTest-774474103 None] Delete group completed successfully.
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-2bd287fb-d8f2-4754-a513-6c1c8fbac973-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-2bd287fb-d8f2-4754-a513-6c1c8fbac973-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-quobyte-2bd287fb-d8f2-4754-a513-6c1c8fbac973" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-2bd287fb-d8f2-4754-a513-6c1c8fbac973" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Deleting offline snapshot 2bd287fb-d8f2-4754-a513-6c1c8fbac973 of volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] snapshot_file for this snap is: volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f4c0e9-8cf4-4e78-80c0-b601362c100c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:55 devstack sudo[83956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973
Apr 17 05:27:55 devstack sudo[83956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:55 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] group_snapshot 4285c887-00e0-4c8c-a333-1812bb6db199: deleting
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] group_snapshot 4285c887-00e0-4c8c-a333-1812bb6db199: deleting {{(pid=82266) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=107,cinder:UPDATE=133,cinder:INSERT=19,cinder:DELETE=8 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-f80e6031-a4c8-4769-b0db-49c0bacf687d" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-f80e6031-a4c8-4769-b0db-49c0bacf687d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Deleting offline snapshot f80e6031-a4c8-4769-b0db-49c0bacf687d of volume 0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] snapshot_file for this snap is: volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce13797-e796-46ea-8e10-3d2fdc551ea7]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:55 devstack sudo[83964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d
Apr 17 05:27:55 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:56 devstack sudo[83956]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973" returned: 0 in 0.555s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab15184-8700-473b-9f7a-445e1306a7f0]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:56 devstack sudo[83969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:27:56 devstack sudo[83969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:56 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d" returned: 0 in 0.503s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2233c9-2ca4-43eb-bb34-b1584adfcf0c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:56 devstack sudo[83974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e
Apr 17 05:27:56 devstack sudo[83974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:56 devstack sudo[83969]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 0.631s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:27:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:56 devstack sudo[84011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973
Apr 17 05:27:56 devstack sudo[84011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:56 devstack sudo[83974]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" returned: 0 in 0.660s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:57 devstack sudo[84018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d
Apr 17 05:27:57 devstack sudo[84018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:57 devstack sudo[84011]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973" returned: 0 in 1.019s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:57 devstack sudo[84051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973
Apr 17 05:27:57 devstack sudo[84051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:57 devstack sudo[84018]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d" returned: 0 in 0.894s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:57 devstack sudo[84053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d
Apr 17 05:27:57 devstack sudo[84053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:27:58 devstack sudo[84053]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e.f80e6031-a4c8-4769-b0db-49c0bacf687d" returned: 0 in 0.504s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-f80e6031-a4c8-4769-b0db-49c0bacf687d" released by "_delete_snapshot" :: held 2.638s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" released by "delete_snapshot" :: held 2.652s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:58 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:UPDATE=103,cinder:SELECT=121,cinder:INSERT=32,cinder:DELETE=9 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:27:58 devstack sudo[84051]: pam_unix(sudo:session): session closed for user root
Apr 17 05:27:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.2bd287fb-d8f2-4754-a513-6c1c8fbac973" returned: 0 in 0.699s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:27:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-2bd287fb-d8f2-4754-a513-6c1c8fbac973" released by "_delete_snapshot" :: held 2.963s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:58 devstack cinder-volume[82266]: WARNING cinder.quota [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1289966788 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1289966788, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:27:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" released by "delete_snapshot" :: held 2.983s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:58 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] Created reservations ['5e9992aa-df17-4b34-89d6-bd83a958aaac', '8e5edfb8-536b-4475-ba62-f53cc005dadd', 'c87cee02-f579-435a-adee-36ebcaf49a43', '87f67d3c-ba6b-4ca8-94e6-1595809a7aad'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:58 devstack cinder-volume[82266]: WARNING cinder.quota [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:27:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dfdaf169-3190-4cfd-a3ae-a7d8cf6bc1b7 tempest-GroupSnapshotsTest-774474103 None] group_snapshot 4285c887-00e0-4c8c-a333-1812bb6db199: deleted successfully
Apr 17 05:27:58 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Created reservations ['e8d356ac-cbd9-4e82-97de-6b2fd877350d', 'b7bf71e1-5595-4eaf-8259-12b558a8235f', '7e03ab40-37b3-4c10-bca5-baae3ccdbc0a', '1c3a087e-f624-4807-afbf-51608e6dda76'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:27:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Delete snapshot completed successfully.
Apr 17 05:27:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1911836-f24d-4359-93b8-dfe40d6fca4d tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-2bd287fb-d8f2-4754-a513-6c1c8fbac973-delete_snapshot" released by "delete_snapshot" :: held 3.120s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:27:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:27:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:27:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] Creating offline snapshot c8341982-50c4-4cb8-ac2c-ec68b8de9f54 of volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:27:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:27:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:27:59 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ef66cf-1b5e-41c8-a6bc-843e591dde29]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:59 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3a28e6-bf91-4765-b07e-79f6e7e9497d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:27:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:27:59 devstack sudo[84064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e
Apr 17 05:27:59 devstack sudo[84064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:00 devstack sudo[84063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:28:00 devstack sudo[84063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:00 devstack sudo[84064]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" returned: 0 in 0.994s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:00 devstack sudo[84080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e
Apr 17 05:28:00 devstack sudo[84080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:01 devstack sudo[84063]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 1.591s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:01 devstack sudo[84092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54 1G
Apr 17 05:28:01 devstack sudo[84092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:01 devstack sudo[84080]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" returned: 0 in 1.069s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:01 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-0ecf926b-fe20-4fd0-981c-4b1d4a9e6e0e" released by "delete_volume" :: held 2.215s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Created reservations ['02e0407d-7c72-45c4-8d35-957ac0c08124'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:02 devstack cinder-volume[82266]: WARNING cinder.db.sqlalchemy.api [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1289966788']
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Created reservations ['c03d66e2-9a6f-4986-9de2-4b55dad7440f', 'e05293ac-92cb-4e08-9bc0-f212fb68dfdf', '8d02e668-a4fb-4a3b-b192-3175a48d81b4', 'b0d3214b-ac54-4332-86cd-7ecc1e22a308'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:02 devstack sudo[84131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:28:02 devstack sudo[84131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:02 devstack sudo[84131]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.473s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:28:02 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8a740090-2993-49fc-8281-63d0a9712eb4 tempest-GroupSnapshotsTest-774474103 None] Delete group completed successfully.
Apr 17 05:28:02 devstack sudo[84092]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54 1G" returned: 0 in 1.220s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:02 devstack sudo[84136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54
Apr 17 05:28:02 devstack sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:03 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1c87e84c-b557-4fd6-b91c-0889a0daf38d tempest-GroupSnapshotsTest-774474103 None] Group tempest-GroupSnapshotsTest-Group-2113663179: creating
Apr 17 05:28:03 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1c87e84c-b557-4fd6-b91c-0889a0daf38d tempest-GroupSnapshotsTest-774474103 None] Group tempest-GroupSnapshotsTest-Group-2113663179: created successfully
Apr 17 05:28:03 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1c87e84c-b557-4fd6-b91c-0889a0daf38d tempest-GroupSnapshotsTest-774474103 None] Create group completed successfully.
Apr 17 05:28:03 devstack sudo[84136]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54" returned: 0 in 0.812s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:03 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54 is being set with open permissions: ugo+rw
Apr 17 05:28:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:03 devstack sudo[84142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54
Apr 17 05:28:03 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:03 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54" returned: 0 in 0.462s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.363s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:03 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-b0d973b4-df40-42f7-b9fa-d3700860571a tempest-SnapshotsActionsTest-2056862822 None] Create snapshot completed successfully
Apr 17 05:28:04 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:28:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Flow 'volume_create_manager' (0f74a54f-598b-40d8-b191-349e01418053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea5ecd6-73fb-4e94-b98f-e64a10956fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea5ecd6-73fb-4e94-b98f-e64a10956fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-566444065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9452d67c-512b-4379-8728-c89e27fe057b,host='devstack@QuobyteHD#QuobyteHD',id=c62f2d0c-70de-4559-a43f-26e856ac32e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e4a249240f47dc9f23ded352235cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:05Z,use_quota=True,user_id='718866c1b0f14268b9b52dfcdc42d4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7052a1c8-258b-46ce-8d7d-d6543bfb0fd2),volume_type_id=7052a1c8-258b-46ce-8d7d-d6543bfb0fd2)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c982ea0e-e05b-4062-bcf3-c38bbd98b737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c982ea0e-e05b-4062-bcf3-c38bbd98b737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e8dc4e-a3df-4d8f-aa9f-93c95ef30707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e8dc4e-a3df-4d8f-aa9f-93c95ef30707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62f2d0c-70de-4559-a43f-26e856ac32e4', 'volume_name': 'volume-c62f2d0c-70de-4559-a43f-26e856ac32e4', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f815308-842e-4b5c-ab54-04afefd86148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f815308-842e-4b5c-ab54-04afefd86148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657014ef-f29a-4907-bfdf-745fb781359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:05 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Volume c62f2d0c-70de-4559-a43f-26e856ac32e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62f2d0c-70de-4559-a43f-26e856ac32e4', 'volume_size': 1}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9452d67c-512b-4379-8728-c89e27fe057b,created_at=2026-04-17T03:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-566444065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9452d67c-512b-4379-8728-c89e27fe057b,host='devstack@QuobyteHD#QuobyteHD',id=c62f2d0c-70de-4559-a43f-26e856ac32e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e4a249240f47dc9f23ded352235cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:05Z,use_quota=True,user_id='718866c1b0f14268b9b52dfcdc42d4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7052a1c8-258b-46ce-8d7d-d6543bfb0fd2),volume_type_id=7052a1c8-258b-46ce-8d7d-d6543bfb0fd2)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Creating volume c62f2d0c-70de-4559-a43f-26e856ac32e4 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:28:05 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-c8341982-50c4-4cb8-ac2c-ec68b8de9f54-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:05 devstack sudo[84178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 1073741824
Apr 17 05:28:05 devstack sudo[84178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-c8341982-50c4-4cb8-ac2c-ec68b8de9f54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-quobyte-c8341982-50c4-4cb8-ac2c-ec68b8de9f54" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-c8341982-50c4-4cb8-ac2c-ec68b8de9f54" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Deleting offline snapshot c8341982-50c4-4cb8-ac2c-ec68b8de9f54 of volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] snapshot_file for this snap is: volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ada66-dfb8-4aa7-965e-7c25574ca54c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:05 devstack sudo[84180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54
Apr 17 05:28:05 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:05 devstack sudo[84178]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 1073741824" returned: 0 in 0.690s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:05 devstack sudo[84190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4
Apr 17 05:28:05 devstack sudo[84190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:05 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54" returned: 0 in 0.667s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[032a678c-8de2-47a4-aec7-8dc0abca1b23]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:05 devstack sudo[84192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:28:05 devstack sudo[84192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:06 devstack sudo[84192]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 0.957s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:06 devstack sudo[84238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54
Apr 17 05:28:06 devstack sudo[84238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:06 devstack sudo[84190]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4" returned: 0 in 1.191s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:28:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657014ef-f29a-4907-bfdf-745fb781359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62f2d0c-70de-4559-a43f-26e856ac32e4', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ff70b4-a470-422c-8b1c-6d51ab11b3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:06 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Volume volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 (c62f2d0c-70de-4559-a43f-26e856ac32e4): created successfully
Apr 17 05:28:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ff70b4-a470-422c-8b1c-6d51ab11b3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Flow 'volume_create_manager' (0f74a54f-598b-40d8-b191-349e01418053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ba21f801-3307-4bda-a8cf-1a32abf59813 tempest-GroupSnapshotsTest-774474103 None] Created volume successfully.
Apr 17 05:28:07 devstack sudo[84238]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54" returned: 0 in 0.684s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:07 devstack sudo[84248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54
Apr 17 05:28:07 devstack sudo[84248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:07 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:28:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Flow 'volume_create_manager' (4450433e-0d4a-43c7-bc2d-800d0bbdfbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbcb355-ec11-4c19-908d-d0565d81d5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbcb355-ec11-4c19-908d-d0565d81d5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-241394964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9452d67c-512b-4379-8728-c89e27fe057b,host='devstack@QuobyteHD#QuobyteHD',id=34cdf276-aeb6-42f1-9100-67113234dfb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e4a249240f47dc9f23ded352235cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:08Z,use_quota=True,user_id='718866c1b0f14268b9b52dfcdc42d4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7052a1c8-258b-46ce-8d7d-d6543bfb0fd2),volume_type_id=7052a1c8-258b-46ce-8d7d-d6543bfb0fd2)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a06827b-dd9f-4edb-9ece-fe1857a2d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a06827b-dd9f-4edb-9ece-fe1857a2d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e186e3-e142-4d28-a9f4-1afabf80c8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e186e3-e142-4d28-a9f4-1afabf80c8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34cdf276-aeb6-42f1-9100-67113234dfb1', 'volume_name': 'volume-34cdf276-aeb6-42f1-9100-67113234dfb1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319e01b0-9640-418c-8c9f-cee5eeb4d368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319e01b0-9640-418c-8c9f-cee5eeb4d368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6130864e-62dd-4bcf-b240-14b3ee8868c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:08 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Volume 34cdf276-aeb6-42f1-9100-67113234dfb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34cdf276-aeb6-42f1-9100-67113234dfb1', 'volume_size': 1}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9452d67c-512b-4379-8728-c89e27fe057b,created_at=2026-04-17T03:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-241394964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9452d67c-512b-4379-8728-c89e27fe057b,host='devstack@QuobyteHD#QuobyteHD',id=34cdf276-aeb6-42f1-9100-67113234dfb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e4a249240f47dc9f23ded352235cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:08Z,use_quota=True,user_id='718866c1b0f14268b9b52dfcdc42d4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7052a1c8-258b-46ce-8d7d-d6543bfb0fd2),volume_type_id=7052a1c8-258b-46ce-8d7d-d6543bfb0fd2)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Creating volume 34cdf276-aeb6-42f1-9100-67113234dfb1 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:28:08 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:08 devstack sudo[84262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1 1073741824
Apr 17 05:28:08 devstack sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:08 devstack sudo[84248]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.c8341982-50c4-4cb8-ac2c-ec68b8de9f54" returned: 0 in 0.876s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-c8341982-50c4-4cb8-ac2c-ec68b8de9f54" released by "_delete_snapshot" :: held 3.269s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" released by "delete_snapshot" :: held 3.280s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Created reservations ['0e3eb648-6219-4507-a754-21d019e6127d', 'b10ec92a-c8d2-47c6-91b6-f34bf3e3de6a', 'a1a62c27-514f-49b3-af70-4e12975a255f', '6ce4c2b5-ce95-44ee-a042-ee3be1052007'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:08 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Delete snapshot completed successfully.
Apr 17 05:28:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-23b1ff62-262e-4516-92b4-7d3f2a8088ec tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-c8341982-50c4-4cb8-ac2c-ec68b8de9f54-delete_snapshot" released by "delete_snapshot" :: held 3.521s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:09 devstack sudo[84262]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1 1073741824" returned: 0 in 1.101s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:09 devstack sudo[84274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1
Apr 17 05:28:09 devstack sudo[84274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:10 devstack sudo[84274]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1" returned: 0 in 0.837s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.494s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] Creating offline snapshot 6df03c7b-84fb-4900-8f99-d59b1c62c593 of volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6130864e-62dd-4bcf-b240-14b3ee8868c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34cdf276-aeb6-42f1-9100-67113234dfb1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b4769d-40d8-42c2-a0b9-47085ad50737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[df918d5f-5939-4b0c-b1d8-7d84ad47975d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:10 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Volume volume-34cdf276-aeb6-42f1-9100-67113234dfb1 (34cdf276-aeb6-42f1-9100-67113234dfb1): created successfully
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b4769d-40d8-42c2-a0b9-47085ad50737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Flow 'volume_create_manager' (4450433e-0d4a-43c7-bc2d-800d0bbdfbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:10 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c651fcc0-e8fc-4182-b43e-310eac81afb9 tempest-GroupSnapshotsTest-774474103 None] Created volume successfully.
Apr 17 05:28:10 devstack sudo[84307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:28:10 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:10 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 0.716s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:10 devstack sudo[84314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593 1G
Apr 17 05:28:10 devstack sudo[84314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:11 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4b32b3c9-113a-4944-a5c3-1de2af81eaab tempest-GroupSnapshotsTest-774474103 None] Update group completed successfully.
Apr 17 05:28:11 devstack sudo[84314]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593 1G" returned: 0 in 1.079s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:28:12 devstack sudo[84319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593
Apr 17 05:28:12 devstack sudo[84319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Flow 'volume_create_manager' (6e903ed0-f3e1-423f-ba5c-5072bd6518dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b7cc96-d72d-47e3-951e-862218f8898e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b7cc96-d72d-47e3-951e-862218f8898e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-637874360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea48c651-2159-46ec-9f06-d8b135ebd8b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a09898d1e474f9b9ad22eb38c203a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:12Z,use_quota=True,user_id='b7cb9a3ee9d641caa11bfdfba341378c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b1c0ad-8bec-4f0d-b114-d1c33669b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b1c0ad-8bec-4f0d-b114-d1c33669b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b28ed9a-eb2c-407b-9fd6-7ab11c61a866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b28ed9a-eb2c-407b-9fd6-7ab11c61a866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea48c651-2159-46ec-9f06-d8b135ebd8b5', 'volume_name': 'volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e35056-cb32-4c55-82bf-d8315d30ee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e35056-cb32-4c55-82bf-d8315d30ee78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02682ef1-2dc4-4e3c-b832-27b551b92018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:12 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Volume ea48c651-2159-46ec-9f06-d8b135ebd8b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5', 'volume_size': 1}
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:12 devstack sudo[84319]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593" returned: 0 in 0.679s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:12 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593 is being set with open permissions: ugo+rw
Apr 17 05:28:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:12 devstack sudo[84329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593
Apr 17 05:28:12 devstack sudo[84329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:12 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e6f66acc-4510-4a83-913a-4469112232d2 tempest-GroupSnapshotsTest-774474103 None] Update group completed successfully.
Apr 17 05:28:13 devstack sudo[84329]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593" returned: 0 in 0.525s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.139s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.094s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-637874360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea48c651-2159-46ec-9f06-d8b135ebd8b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a09898d1e474f9b9ad22eb38c203a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:12Z,use_quota=True,user_id='b7cb9a3ee9d641caa11bfdfba341378c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Creating volume ea48c651-2159-46ec-9f06-d8b135ebd8b5 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:28:13 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:28:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:13 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-6b1e0e17-426f-46d8-ad88-089d4ff9b5d0 tempest-SnapshotsActionsTest-2056862822 None] Create snapshot completed successfully
Apr 17 05:28:13 devstack sudo[84347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5 1073741824
Apr 17 05:28:13 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:13 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a65ba3c1-9bd3-4bf7-b7b7-b4f1b65c507f tempest-GroupSnapshotsTest-774474103 None] Update group completed successfully.
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-6df03c7b-84fb-4900-8f99-d59b1c62c593-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-6df03c7b-84fb-4900-8f99-d59b1c62c593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-quobyte-6df03c7b-84fb-4900-8f99-d59b1c62c593" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-6df03c7b-84fb-4900-8f99-d59b1c62c593" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Deleting offline snapshot 6df03c7b-84fb-4900-8f99-d59b1c62c593 of volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] snapshot_file for this snap is: volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7010e5e9-caec-43a6-9d55-edc9e7566ea9]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:14 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5 1073741824" returned: 0 in 1.006s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:14 devstack sudo[84359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593
Apr 17 05:28:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:14 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:14 devstack sudo[84361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5
Apr 17 05:28:14 devstack sudo[84361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:15 devstack sudo[84361]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5" returned: 0 in 0.837s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ce44d52c-6f7a-413a-bfea-9705b61d1af0 tempest-GroupSnapshotsTest-774474103 None] Update group completed successfully.
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02682ef1-2dc4-4e3c-b832-27b551b92018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2706c5a9-3b6e-4065-95e4-ebd999d8f82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:15 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Volume volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5 (ea48c651-2159-46ec-9f06-d8b135ebd8b5): created successfully
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2706c5a9-3b6e-4065-95e4-ebd999d8f82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Flow 'volume_create_manager' (6e903ed0-f3e1-423f-ba5c-5072bd6518dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-0ae73bdc-a903-4d91-a071-9792e3a5fade tempest-ServerRescueNegativeTestJSON-659359309 None] Created volume successfully.
Apr 17 05:28:15 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593" returned: 0 in 1.164s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe3c677-e447-4078-8e3b-02b86723836e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:15 devstack sudo[84368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:28:15 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:16 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 0.905s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:16 devstack sudo[84373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593
Apr 17 05:28:16 devstack sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:16 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] GroupSnapshot 0cf1ad83-af3e-407a-a85e-57effd7c5144: creating.
Apr 17 05:28:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Group snapshot 0cf1ad83-af3e-407a-a85e-57effd7c5144: creating. {{(pid=82266) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 17 05:28:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Creating offline snapshot 40defc88-5502-4aab-b967-eb1fa2423f62 of volume 34cdf276-aeb6-42f1-9100-67113234dfb1 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:28:17 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b687ef7-3212-43af-820b-5557d42177cc]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:17 devstack sudo[84379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1
Apr 17 05:28:17 devstack sudo[84379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:17 devstack sudo[84373]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593" returned: 0 in 1.438s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:17 devstack sudo[84379]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1" returned: 0 in 0.784s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:17 devstack sudo[84385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593
Apr 17 05:28:17 devstack sudo[84385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:17 devstack sudo[84387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62 1G
Apr 17 05:28:17 devstack sudo[84387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:19 devstack sudo[84385]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.6df03c7b-84fb-4900-8f99-d59b1c62c593" returned: 0 in 1.261s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-6df03c7b-84fb-4900-8f99-d59b1c62c593" released by "_delete_snapshot" :: held 5.003s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" released by "delete_snapshot" :: held 5.018s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:19 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Created reservations ['3c9043b3-8058-42d6-9bc1-efde64cd86bc', '9857b336-0aff-43b2-ba72-7f8282105902', '2f193242-adbd-4da7-8966-be4b8114b3a8', '4a17fcd3-2b2e-481c-b346-8b83361da0be'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:19 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Delete snapshot completed successfully.
Apr 17 05:28:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6adcefc2-9026-473a-a2b7-e31877bfba0e tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-6df03c7b-84fb-4900-8f99-d59b1c62c593-delete_snapshot" released by "delete_snapshot" :: held 5.246s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:19 devstack sudo[84387]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62 1G" returned: 0 in 1.572s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cdf276-aeb6-42f1-9100-67113234dfb1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:19 devstack sudo[84400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cdf276-aeb6-42f1-9100-67113234dfb1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62
Apr 17 05:28:19 devstack sudo[84400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:20 devstack sudo[84400]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cdf276-aeb6-42f1-9100-67113234dfb1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62" returned: 0 in 0.795s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:20 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62 is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:28:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:20 devstack sudo[84405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62
Apr 17 05:28:20 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:20 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62" returned: 0 in 0.443s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:20 devstack sudo[84408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.info
Apr 17 05:28:20 devstack sudo[84408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:21 devstack sudo[84408]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.info" returned: 0 in 0.652s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:21 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:28:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:21 devstack sudo[84435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.info
Apr 17 05:28:21 devstack sudo[84435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:21 devstack sudo[84435]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.info" returned: 0 in 0.462s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.864s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Creating offline snapshot b01c7da6-0ae8-4c50-854a-00ffbd3d606f of volume c62f2d0c-70de-4559-a43f-26e856ac32e4 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:28:21 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5050bea1-1a6b-47e6-86fc-63d44b17b838]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:21 devstack sudo[84440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4
Apr 17 05:28:21 devstack sudo[84440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:22 devstack sudo[84440]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4" returned: 0 in 0.510s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:22 devstack sudo[84452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f 1G
Apr 17 05:28:22 devstack sudo[84452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:22 devstack sudo[84452]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f 1G" returned: 0 in 0.531s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:22 devstack sudo[84457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f
Apr 17 05:28:22 devstack sudo[84457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:23 devstack sudo[84457]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f" returned: 0 in 0.501s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:23 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:28:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:23 devstack sudo[84464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f
Apr 17 05:28:23 devstack sudo[84464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:23 devstack sudo[84464]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f" returned: 0 in 0.612s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:24 devstack sudo[84467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.info
Apr 17 05:28:24 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:24 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.info" returned: 0 in 0.540s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:24 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:28:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:24 devstack sudo[84471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.info
Apr 17 05:28:24 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Flow 'volume_create_manager' (148dde2a-22e7-4bbd-94e8-45a3187fc0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:25 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58adb1a7-6108-4ca7-a4b4-44e716f75fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58adb1a7-6108-4ca7-a4b4-44e716f75fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:25Z,deleted=False,deleted_at=None,display_description='',display_name='d0729562-2997-49d6-ad90-2b64438f5646-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aeb05c0-b07a-408f-9e83-2192be9e99a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edaceaad1fcd4ecb8bdf15919b110a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:25Z,use_quota=True,user_id='baaf40a28d154d7ca0dc70948794dd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887d916e-0e4a-4084-9127-07a8b938c23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887d916e-0e4a-4084-9127-07a8b938c23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83ae8b3-3420-49c0-ab31-100541e6d431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83ae8b3-3420-49c0-ab31-100541e6d431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aeb05c0-b07a-408f-9e83-2192be9e99a0', 'volume_name': 'volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0bbe22-a57c-4926-9c84-39b4c1410576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0bbe22-a57c-4926-9c84-39b4c1410576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9468663f-2678-4664-92e4-6cce1f7ff640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:25 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Volume 8aeb05c0-b07a-408f-9e83-2192be9e99a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0', 'volume_size': 1}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.info" returned: 0 in 0.779s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.541s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.585s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] Creating offline snapshot 70889a53-9bd5-4930-b351-93a91c3b3891 of volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8671417b-6dd9-4574-aa1e-173f91578a3d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:25 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8ff56cec-84cc-4f75-b4b0-7ed3bd7c4799 tempest-GroupSnapshotsTest-774474103 None] group_snapshot 0cf1ad83-af3e-407a-a85e-57effd7c5144: created successfully
Apr 17 05:28:25 devstack sudo[84474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:28:25 devstack sudo[84474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:26 devstack sudo[84474]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 0.809s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:26 devstack sudo[84509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891 1G
Apr 17 05:28:26 devstack sudo[84509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:26 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] group_snapshot 0cf1ad83-af3e-407a-a85e-57effd7c5144: deleting
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] group_snapshot 0cf1ad83-af3e-407a-a85e-57effd7c5144: deleting {{(pid=82266) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-34cdf276-aeb6-42f1-9100-67113234dfb1" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-34cdf276-aeb6-42f1-9100-67113234dfb1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-40defc88-5502-4aab-b967-eb1fa2423f62" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-40defc88-5502-4aab-b967-eb1fa2423f62" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Deleting offline snapshot 40defc88-5502-4aab-b967-eb1fa2423f62 of volume 34cdf276-aeb6-42f1-9100-67113234dfb1 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] snapshot_file for this snap is: volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7c5683-8b3c-4377-9fbe-9d36fec336df]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:27 devstack sudo[84511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62
Apr 17 05:28:27 devstack sudo[84511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:27 devstack sudo[84511]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62" returned: 0 in 0.763s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34cdf276-aeb6-42f1-9100-67113234dfb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:27 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[466cad68-2e2a-4314-a9d7-db51717ef5d2]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:27 devstack sudo[84521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1
Apr 17 05:28:27 devstack sudo[84521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:27 devstack sudo[84509]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891 1G" returned: 0 in 1.675s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:27 devstack sudo[84524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891
Apr 17 05:28:27 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:28 devstack sudo[84521]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1" returned: 0 in 1.161s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:28 devstack sudo[84533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62
Apr 17 05:28:28 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:28 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891" returned: 0 in 1.025s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:28 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891 is being set with open permissions: ugo+rw
Apr 17 05:28:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:28 devstack sudo[84535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891
Apr 17 05:28:28 devstack sudo[84535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:29 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62" returned: 0 in 0.525s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:29 devstack sudo[84541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62
Apr 17 05:28:29 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:29 devstack sudo[84535]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891" returned: 0 in 0.469s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.069s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.113s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:25Z,deleted=False,deleted_at=None,display_description='',display_name='d0729562-2997-49d6-ad90-2b64438f5646-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aeb05c0-b07a-408f-9e83-2192be9e99a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edaceaad1fcd4ecb8bdf15919b110a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:25Z,use_quota=True,user_id='baaf40a28d154d7ca0dc70948794dd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Creating volume 8aeb05c0-b07a-408f-9e83-2192be9e99a0 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:28:29 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:28:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:29 devstack sudo[84543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0 1073741824
Apr 17 05:28:29 devstack sudo[84543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:29 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-fb7c0bc9-1bc1-48c4-83e9-2a2ab1faa14a tempest-SnapshotsActionsTest-2056862822 None] Create snapshot completed successfully
Apr 17 05:28:30 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1.40defc88-5502-4aab-b967-eb1fa2423f62" returned: 0 in 0.691s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-40defc88-5502-4aab-b967-eb1fa2423f62" released by "_delete_snapshot" :: held 3.295s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-34cdf276-aeb6-42f1-9100-67113234dfb1" released by "delete_snapshot" :: held 3.310s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-c62f2d0c-70de-4559-a43f-26e856ac32e4" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-c62f2d0c-70de-4559-a43f-26e856ac32e4" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-b01c7da6-0ae8-4c50-854a-00ffbd3d606f" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-b01c7da6-0ae8-4c50-854a-00ffbd3d606f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Deleting offline snapshot b01c7da6-0ae8-4c50-854a-00ffbd3d606f of volume c62f2d0c-70de-4559-a43f-26e856ac32e4 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] snapshot_file for this snap is: volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da2123f-0b2a-4d48-8a0d-5afbc46748d5]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:30 devstack sudo[84547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f
Apr 17 05:28:30 devstack sudo[84547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-70889a53-9bd5-4930-b351-93a91c3b3891-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-70889a53-9bd5-4930-b351-93a91c3b3891-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Acquiring lock "cinder-quobyte-70889a53-9bd5-4930-b351-93a91c3b3891" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-70889a53-9bd5-4930-b351-93a91c3b3891" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Deleting offline snapshot 70889a53-9bd5-4930-b351-93a91c3b3891 of volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] snapshot_file for this snap is: volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5644503-4277-4252-8308-20baf94dde74]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:30 devstack sudo[84552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891
Apr 17 05:28:30 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:30 devstack sudo[84543]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0 1073741824" returned: 0 in 1.151s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:30 devstack sudo[84554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0
Apr 17 05:28:30 devstack sudo[84554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:30 devstack sudo[84547]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f" returned: 0 in 0.837s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c62f2d0c-70de-4559-a43f-26e856ac32e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea2fad-f3d0-495a-85a3-6c562d6369b9]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:31 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891" returned: 0 in 0.736s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:31 devstack sudo[84562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4
Apr 17 05:28:31 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[39893075-73aa-4cdb-bcf8-623543916115]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:31 devstack sudo[84554]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0" returned: 0 in 0.802s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:31 devstack sudo[84571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:28:31 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9468663f-2678-4664-92e4-6cce1f7ff640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b760467-b0f8-41ac-a2ff-f43bee0c70ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Volume volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0 (8aeb05c0-b07a-408f-9e83-2192be9e99a0): created successfully
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b760467-b0f8-41ac-a2ff-f43bee0c70ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Flow 'volume_create_manager' (148dde2a-22e7-4bbd-94e8-45a3187fc0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:31 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-a62f44b5-0f94-4f00-81a2-88b6a4113f01 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Created volume successfully.
Apr 17 05:28:32 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4" returned: 0 in 1.253s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:32 devstack sudo[84622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f
Apr 17 05:28:32 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:32 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 1.209s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:32 devstack sudo[84626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891
Apr 17 05:28:32 devstack sudo[84626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:33 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f" returned: 0 in 1.159s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:33 devstack sudo[84636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f
Apr 17 05:28:33 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:33 devstack sudo[84626]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891" returned: 0 in 1.268s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:33 devstack sudo[84638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891
Apr 17 05:28:33 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:33 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4.b01c7da6-0ae8-4c50-854a-00ffbd3d606f" returned: 0 in 0.524s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-b01c7da6-0ae8-4c50-854a-00ffbd3d606f" released by "_delete_snapshot" :: held 3.917s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-c62f2d0c-70de-4559-a43f-26e856ac32e4" released by "delete_snapshot" :: held 3.934s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:34 devstack cinder-volume[82266]: WARNING cinder.quota [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2135499158 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2135499158, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:28:34 devstack cinder-volume[82266]: WARNING cinder.quota [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2135499158 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2135499158, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Created reservations ['fc4ee9a2-845e-4324-a00c-13be090c5b82', 'cabbb528-e6c3-499d-977f-ef52340409ce', '71560ad0-3acf-4a28-bcbf-7552d343c83a', '65c0e0fe-c92a-4213-8527-8a8dc31e8b3b'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:34 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.70889a53-9bd5-4930-b351-93a91c3b3891" returned: 0 in 0.626s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-70889a53-9bd5-4930-b351-93a91c3b3891" released by "_delete_snapshot" :: held 3.972s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" released by "delete_snapshot" :: held 3.999s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] Created reservations ['8002cb67-07c6-4702-9352-5bb26684e8c4', '0c40b505-a95b-4653-a624-352ed848bd95', 'b2113c4a-24d1-4711-b4c6-2813560601dc', '527dbf3b-2cb6-4d3e-a887-cc93b95b12e1'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:34 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-0d15a1b7-2a19-4f5b-8ed5-04c862cff2de tempest-GroupSnapshotsTest-774474103 None] group_snapshot 0cf1ad83-af3e-407a-a85e-57effd7c5144: deleted successfully
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Created reservations ['4c4a6be7-5b7b-4c6a-a3b2-d28fe967848b', 'd042accc-68cb-4dde-bc4d-133b1c8bbf29', 'a290b9c7-b7b7-4683-852b-0919c20185a4', '080bccc0-38ab-4d4b-918e-ef87eec48d99'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:34 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Delete snapshot completed successfully.
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c64afe20-5561-47e2-a147-2115e63ffb23 tempest-SnapshotsActionsTest-1096319300 None] Lock "cinder-70889a53-9bd5-4930-b351-93a91c3b3891-delete_snapshot" released by "delete_snapshot" :: held 4.156s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Acquiring lock "cinder-ea48c651-2159-46ec-9f06-d8b135ebd8b5-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Lock "cinder-ea48c651-2159-46ec-9f06-d8b135ebd8b5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Acquiring lock "cinder-quobyte-ea48c651-2159-46ec-9f06-d8b135ebd8b5" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Lock "cinder-quobyte-ea48c651-2159-46ec-9f06-d8b135ebd8b5" acquired by "delete_volume" :: waited 0.031s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29b627-607c-4bfa-a916-426fd3b88449]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:35 devstack sudo[84653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5
Apr 17 05:28:35 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-60f50669-3748-4079-8e62-b8fe15e5ca97 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-60f50669-3748-4079-8e62-b8fe15e5ca97 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c44262e-9ffe-4466-be9a-af6de6884372]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-60f50669-3748-4079-8e62-b8fe15e5ca97 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "cinder-585b4d77-a7a8-4576-b0ff-42a118e89f4d-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Lock "cinder-585b4d77-a7a8-4576-b0ff-42a118e89f4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "cinder-quobyte-585b4d77-a7a8-4576-b0ff-42a118e89f4d" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Lock "cinder-quobyte-585b4d77-a7a8-4576-b0ff-42a118e89f4d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Deleting offline snapshot 585b4d77-a7a8-4576-b0ff-42a118e89f4d of volume e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:28:35 devstack sudo[84660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0
Apr 17 05:28:35 devstack sudo[84660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] snapshot_file for this snap is: volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49ab488-09be-4ed4-b56d-23430b15589e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:35 devstack sudo[84662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:28:35 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-34cdf276-aeb6-42f1-9100-67113234dfb1" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-34cdf276-aeb6-42f1-9100-67113234dfb1" acquired by "delete_volume" :: waited 0.036s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:36 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5" returned: 0 in 1.105s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ede498-460b-4492-a476-734967ebeed6]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:36 devstack sudo[84671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5
Apr 17 05:28:36 devstack sudo[84671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:36 devstack sudo[84672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1
Apr 17 05:28:36 devstack sudo[84672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:36 devstack sudo[84660]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-60f50669-3748-4079-8e62-b8fe15e5ca97 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0" returned: 0 in 1.266s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-60f50669-3748-4079-8e62-b8fe15e5ca97 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.295s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-60f50669-3748-4079-8e62-b8fe15e5ca97 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12', 'name': 'volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1f5f4fb-e5a9-4fa3-a48e-29df58520645', 'enforce_multipath': True} {{(pid=82266) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 17 05:28:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-e7f1dc31-c2fd-4992-8a35-1b45975a7b70 req-60f50669-3748-4079-8e62-b8fe15e5ca97 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] attachment_update completed successfully.
Apr 17 05:28:36 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 1.369s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e809ba47-79df-4c74-a9c3-f9c980168dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:36 devstack sudo[84672]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1" returned: 0 in 0.841s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed052f2-32d8-407e-a504-1eea58651d5b]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:36 devstack sudo[84671]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ea48c651-2159-46ec-9f06-d8b135ebd8b5" returned: 0 in 0.893s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:36 devstack sudo[84685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1
Apr 17 05:28:36 devstack sudo[84685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Lock "cinder-quobyte-ea48c651-2159-46ec-9f06-d8b135ebd8b5" released by "delete_volume" :: held 2.125s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:37 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Created reservations ['e26d0886-2205-483a-be0e-19354e2c7ff6', 'd6cc5ae4-b444-4871-82e4-56cebd133bb0', 'bc4352c4-82ee-4445-88ba-48d6821c8779', '8b8a2790-4c2f-4fb7-b03b-dae7a650738e'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:37 devstack sudo[84686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc
Apr 17 05:28:37 devstack sudo[84686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:37 devstack sudo[84690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:28:37 devstack sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:37 devstack sudo[84690]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.766s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:37 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:28:37 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Deleted volume successfully.
Apr 17 05:28:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c11518a3-d412-4ede-bfb8-ba38f9b45200 tempest-ServerRescueNegativeTestJSON-659359309 None] Lock "cinder-ea48c651-2159-46ec-9f06-d8b135ebd8b5-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:38 devstack sudo[84685]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-34cdf276-aeb6-42f1-9100-67113234dfb1" returned: 0 in 1.125s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-34cdf276-aeb6-42f1-9100-67113234dfb1" released by "delete_volume" :: held 2.143s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-c62f2d0c-70de-4559-a43f-26e856ac32e4" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-c62f2d0c-70de-4559-a43f-26e856ac32e4" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:38 devstack sudo[84686]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc" returned: 0 in 1.175s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:38 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[049bc0ab-2fda-4572-a358-19571c54ec68]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:38 devstack sudo[84705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:28:38 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:38 devstack sudo[84706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4
Apr 17 05:28:38 devstack sudo[84706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:39 devstack sudo[84706]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4" returned: 0 in 1.035s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:39 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 1.075s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:39 devstack sudo[84810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4
Apr 17 05:28:39 devstack sudo[84810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:39 devstack sudo[84811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d
Apr 17 05:28:39 devstack sudo[84811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:39 devstack sudo[84810]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c62f2d0c-70de-4559-a43f-26e856ac32e4" returned: 0 in 0.570s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-c62f2d0c-70de-4559-a43f-26e856ac32e4" released by "delete_volume" :: held 1.670s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Created reservations ['ed7dd2b4-0940-4894-b7fc-a8253227ce44'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:39 devstack cinder-volume[82266]: WARNING cinder.quota [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2135499158 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2135499158, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Created reservations ['04d284d3-efce-48ef-902b-e18ffa34e52b', '8d83bc15-8094-4e85-997e-c08bb48b0683', '81bd61bc-88d3-4f8b-a68a-e3dc18e3a15e', '1e7a3f4c-eebf-41d7-8cc7-49a816c9186b'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:39 devstack sudo[84811]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc.585b4d77-a7a8-4576-b0ff-42a118e89f4d" returned: 0 in 0.686s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Created reservations ['94a3bad5-9f6d-45da-9200-f8d867a74a9d', 'cfab2bf2-1abf-46bd-8780-da768ba29e18', '42de918e-6f7e-45ca-8fcb-465b627df611', 'fbc0ada6-c7ed-4ce1-ae0e-7af7c4e9f7fe'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Lock "cinder-quobyte-585b4d77-a7a8-4576-b0ff-42a118e89f4d" released by "_delete_snapshot" :: held 4.504s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" released by "delete_snapshot" :: held 4.541s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:39 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Created reservations ['9d2c0b6c-60a9-4619-8809-6fe9f266ea95', '40409b8b-fffe-4b61-843d-79b1a81c4ecf', '13360727-0e2a-4a79-beb9-ce752b9da414', '417873be-a640-41ae-9ac9-f4aacd1efe3b'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:40 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Delete snapshot completed successfully.
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9306ff8-f96f-4427-833b-292f0b76090f tempest-SnapshotsActionsTest-2056862822 None] Lock "cinder-585b4d77-a7a8-4576-b0ff-42a118e89f4d-delete_snapshot" released by "delete_snapshot" :: held 4.665s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:40 devstack sudo[84821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:28:40 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:40 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.586s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:28:40 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a5fbd2fd-d23b-4a11-8bb4-ecc5615a07d9 tempest-GroupSnapshotsTest-774474103 None] Delete group completed successfully.
Apr 17 05:28:40 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-33fdd4c6-e3a6-47e5-9572-f5b7071b93ca tempest-GroupSnapshotsTest-774474103 None] Group tempest-GroupSnapshotsTest-Group-1672359882: creating
Apr 17 05:28:40 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-33fdd4c6-e3a6-47e5-9572-f5b7071b93ca tempest-GroupSnapshotsTest-774474103 None] Group tempest-GroupSnapshotsTest-Group-1672359882: created successfully
Apr 17 05:28:40 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-33fdd4c6-e3a6-47e5-9572-f5b7071b93ca tempest-GroupSnapshotsTest-774474103 None] Create group completed successfully.
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "cinder-e809ba47-79df-4c74-a9c3-f9c980168dcc-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Lock "cinder-e809ba47-79df-4c74-a9c3-f9c980168dcc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:41 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[15833a03-b849-411d-9b07-edd7f267876a]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:41 devstack sudo[84825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc
Apr 17 05:28:41 devstack sudo[84825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:41 devstack sudo[84825]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc" returned: 0 in 0.737s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:41 devstack sudo[85162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc
Apr 17 05:28:41 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:42 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e809ba47-79df-4c74-a9c3-f9c980168dcc" returned: 0 in 0.596s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Lock "cinder-quobyte-e809ba47-79df-4c74-a9c3-f9c980168dcc" released by "delete_volume" :: held 1.425s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Created reservations ['4dee49b8-3ed5-4298-834b-471c85fb1a5a', '18c2cc58-db3e-4aa6-b253-08740fdf9678', 'b404f417-0d67-42f5-8e93-5163bb6105b0', 'fe12891f-2fff-4ed1-8f43-84433385e94f'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Flow 'volume_create_manager' (b150c716-3275-41e8-b2fd-81fcec4bca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3969f673-7c75-4015-a7bd-544bf4e344aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3969f673-7c75-4015-a7bd-544bf4e344aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1035076667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=86aa9775-309d-49de-8733-65eedcc0ed7e,host='devstack@QuobyteHD#QuobyteHD',id=5699f9f9-ea44-4c7f-ae8d-b85a465554d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e4a249240f47dc9f23ded352235cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:43Z,use_quota=True,user_id='718866c1b0f14268b9b52dfcdc42d4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(917e803e-fd89-4fcd-a9cd-694be9afe4e0),volume_type_id=917e803e-fd89-4fcd-a9cd-694be9afe4e0)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffb2bcf-5d24-4e93-bc9c-76ab6db08b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffb2bcf-5d24-4e93-bc9c-76ab6db08b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db81630-ffc1-4c86-b68e-1d5806a459bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db81630-ffc1-4c86-b68e-1d5806a459bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5699f9f9-ea44-4c7f-ae8d-b85a465554d1', 'volume_name': 'volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dfd37d-0f5f-4f51-91d7-aeb9d4d9cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dfd37d-0f5f-4f51-91d7-aeb9d4d9cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530e499a-f754-481a-8526-4c2ce0194d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:42 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Volume 5699f9f9-ea44-4c7f-ae8d-b85a465554d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1', 'volume_size': 1}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=86aa9775-309d-49de-8733-65eedcc0ed7e,created_at=2026-04-17T03:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1035076667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=86aa9775-309d-49de-8733-65eedcc0ed7e,host='devstack@QuobyteHD#QuobyteHD',id=5699f9f9-ea44-4c7f-ae8d-b85a465554d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e4a249240f47dc9f23ded352235cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:43Z,use_quota=True,user_id='718866c1b0f14268b9b52dfcdc42d4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(917e803e-fd89-4fcd-a9cd-694be9afe4e0),volume_type_id=917e803e-fd89-4fcd-a9cd-694be9afe4e0)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Creating volume 5699f9f9-ea44-4c7f-ae8d-b85a465554d1 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:28:42 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:28:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:43 devstack sudo[85172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 1073741824
Apr 17 05:28:43 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:43 devstack sudo[85175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:28:43 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:43 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.782s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:43 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:28:43 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Deleted volume successfully.
Apr 17 05:28:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-34d829de-aedd-4553-b976-27063f5026ed tempest-SnapshotsActionsTest-2056862822 None] Lock "cinder-e809ba47-79df-4c74-a9c3-f9c980168dcc-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:44 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 1073741824" returned: 0 in 1.278s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:44 devstack sudo[85182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1
Apr 17 05:28:44 devstack sudo[85182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:45 devstack sudo[85182]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" returned: 0 in 1.078s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] <== create_volume: return (2408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:28:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.411s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530e499a-f754-481a-8526-4c2ce0194d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a27748-5c82-4584-a036-f5cea5150b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:45 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Volume volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 (5699f9f9-ea44-4c7f-ae8d-b85a465554d1): created successfully
Apr 17 05:28:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a27748-5c82-4584-a036-f5cea5150b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Flow 'volume_create_manager' (b150c716-3275-41e8-b2fd-81fcec4bca9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:45 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dfa20065-5a99-449d-adce-55cf0457976b tempest-GroupSnapshotsTest-774474103 None] Created volume successfully.
Apr 17 05:28:46 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] GroupSnapshot d5e5db09-96b8-486c-a4ec-92f541629404: creating.
Apr 17 05:28:46 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Group snapshot d5e5db09-96b8-486c-a4ec-92f541629404: creating. {{(pid=82266) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 17 05:28:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Creating offline snapshot a528c3d4-2d97-4e63-93c2-3e83ef69b8bb of volume 5699f9f9-ea44-4c7f-ae8d-b85a465554d1 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:28:46 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[737fa9ae-9387-4c73-be9d-b2ed8afac4ea]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:46 devstack sudo[85212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1
Apr 17 05:28:46 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:46 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" returned: 0 in 0.543s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:46 devstack sudo[85226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb 1G
Apr 17 05:28:46 devstack sudo[85226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:47 devstack sudo[85226]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb 1G" returned: 0 in 0.686s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:47 devstack sudo[85233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb
Apr 17 05:28:47 devstack sudo[85233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:47 devstack sudo[85233]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb" returned: 0 in 0.479s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:47 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:28:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:47 devstack sudo[85238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb
Apr 17 05:28:47 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:48 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb" returned: 0 in 0.465s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:48 devstack sudo[85241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.info
Apr 17 05:28:48 devstack sudo[85241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:48 devstack sudo[85241]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.info" returned: 0 in 0.469s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:48 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:28:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:48 devstack sudo[85245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.info
Apr 17 05:28:48 devstack sudo[85245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:49 devstack sudo[85245]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.info" returned: 0 in 0.440s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.200s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:49 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4dd3036c-c3ef-4692-aff7-fc372ae7b1bd tempest-GroupSnapshotsTest-774474103 None] group_snapshot d5e5db09-96b8-486c-a4ec-92f541629404: created successfully
Apr 17 05:28:50 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] group_snapshot d5e5db09-96b8-486c-a4ec-92f541629404: deleting
Apr 17 05:28:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] group_snapshot d5e5db09-96b8-486c-a4ec-92f541629404: deleting {{(pid=82266) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 17 05:28:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-a528c3d4-2d97-4e63-93c2-3e83ef69b8bb" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-a528c3d4-2d97-4e63-93c2-3e83ef69b8bb" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Deleting offline snapshot a528c3d4-2d97-4e63-93c2-3e83ef69b8bb of volume 5699f9f9-ea44-4c7f-ae8d-b85a465554d1 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:28:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] snapshot_file for this snap is: volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:28:50 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f96f8-0d77-4d1b-8147-13a63b70711e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:50 devstack sudo[85276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb
Apr 17 05:28:50 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:51 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb" returned: 0 in 0.713s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:28:51 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c95e09c-bac5-4f8d-8ea1-43bd2e2ceef0]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:51 devstack sudo[85284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1
Apr 17 05:28:51 devstack sudo[85284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:52 devstack sudo[85284]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" returned: 0 in 0.604s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:52 devstack sudo[85304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb
Apr 17 05:28:52 devstack sudo[85304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:52 devstack sudo[85304]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb" returned: 0 in 0.607s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:52 devstack sudo[85309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb
Apr 17 05:28:52 devstack sudo[85309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG oslo_service.periodic_task [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:52 devstack sudo[85311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:28:52 devstack sudo[85311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Flow 'volume_create_manager' (cc5da2b0-4510-441f-a818-fb61d12405b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:53 devstack sudo[85309]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec86ad37-2a3d-4ff2-b457-0498068e8d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec86ad37-2a3d-4ff2-b457-0498068e8d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-674332847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065cc777-0245-4b93-8740-dd4a937dd2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca246cf318c44fcafa9c53966f86b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:53Z,use_quota=True,user_id='277fa676af9a4c4f965f0db9306328e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cc9150-0f9f-4158-bbfb-7563d2c1e951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cc9150-0f9f-4158-bbfb-7563d2c1e951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0225d2-131d-4571-9acf-4843dde0fcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0225d2-131d-4571-9acf-4843dde0fcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065cc777-0245-4b93-8740-dd4a937dd2ef', 'volume_name': 'volume-065cc777-0245-4b93-8740-dd4a937dd2ef', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71bfff7-6ed0-419c-89ba-bab47b48ac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71bfff7-6ed0-419c-89ba-bab47b48ac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693b2f89-911a-41f1-a24d-0076043411cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:53 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Volume 065cc777-0245-4b93-8740-dd4a937dd2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065cc777-0245-4b93-8740-dd4a937dd2ef', 'volume_size': 1}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-674332847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065cc777-0245-4b93-8740-dd4a937dd2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca246cf318c44fcafa9c53966f86b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:53Z,use_quota=True,user_id='277fa676af9a4c4f965f0db9306328e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Creating volume 065cc777-0245-4b93-8740-dd4a937dd2ef {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:28:53 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1.a528c3d4-2d97-4e63-93c2-3e83ef69b8bb" returned: 0 in 0.828s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:53 devstack sudo[85314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef 1073741824
Apr 17 05:28:53 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-a528c3d4-2d97-4e63-93c2-3e83ef69b8bb" released by "_delete_snapshot" :: held 2.861s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" released by "delete_snapshot" :: held 2.875s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:53 devstack cinder-volume[82266]: WARNING cinder.quota [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-706502326 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-706502326, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:28:53 devstack cinder-volume[82266]: WARNING cinder.quota [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-706502326 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-706502326, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] Created reservations ['2bcfe561-0e13-4cd2-8314-06a99eb39bef', 'eaac4fc0-ba3a-4c21-ba58-25d123d0a8b2', '6a5d10b8-ef73-47df-931f-9810d6a0f3dc', 'def97c4a-faa1-4d34-91c1-f0f6c52b3717'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:53 devstack sudo[85311]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.771s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:53 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:28:53 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-13f2bc95-4258-4901-937d-23abd72cafbb tempest-GroupSnapshotsTest-774474103 None] group_snapshot d5e5db09-96b8-486c-a4ec-92f541629404: deleted successfully
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "cinder-quobyte-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" acquired by "delete_volume" :: waited 0.021s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[35808638-2c14-4e74-8669-9c01902a9735]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:54 devstack sudo[85323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1
Apr 17 05:28:54 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:54 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef 1073741824" returned: 0 in 0.836s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:54 devstack sudo[85325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef
Apr 17 05:28:54 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:54 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" returned: 0 in 0.541s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:54 devstack sudo[85331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1
Apr 17 05:28:54 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:54 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693b2f89-911a-41f1-a24d-0076043411cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065cc777-0245-4b93-8740-dd4a937dd2ef', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f06a65-a719-4ed6-a138-995a90fd4ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:54 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Volume volume-065cc777-0245-4b93-8740-dd4a937dd2ef (065cc777-0245-4b93-8740-dd4a937dd2ef): created successfully
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f06a65-a719-4ed6-a138-995a90fd4ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Flow 'volume_create_manager' (cc5da2b0-4510-441f-a818-fb61d12405b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:54 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-17233a39-c1b0-4c30-9137-6d7f077d06de tempest-VolumeQuotasAdminTestJSON-1693456341 None] Created volume successfully.
Apr 17 05:28:55 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" returned: 0 in 0.511s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Lock "cinder-quobyte-5699f9f9-ea44-4c7f-ae8d-b85a465554d1" released by "delete_volume" :: held 1.111s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Created reservations ['bd9bbd8a-395f-4cf8-82ab-7b25eebb9536'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:55 devstack cinder-volume[82266]: WARNING cinder.quota [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-706502326 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-706502326, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Created reservations ['3b9a812a-694d-4146-9df3-69a7c2991c73', '4be8db79-660c-4426-ba05-43f49c6c6099', '8455a07d-a039-4dec-9e01-d957ce1dc120', '4120488c-bf38-41da-8628-9df3b7c95227'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:55 devstack sudo[85334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:28:55 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Acquiring lock "cinder-065cc777-0245-4b93-8740-dd4a937dd2ef-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "cinder-065cc777-0245-4b93-8740-dd4a937dd2ef-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Acquiring lock "cinder-quobyte-065cc777-0245-4b93-8740-dd4a937dd2ef" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "cinder-quobyte-065cc777-0245-4b93-8740-dd4a937dd2ef" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c3ec5c-12e9-4107-a9df-1c71dee001eb]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:28:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:55 devstack sudo[85364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef
Apr 17 05:28:55 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:56 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.711s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:56 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:28:56 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1e774bde-20ee-4f68-8445-c5337a355101 tempest-GroupSnapshotsTest-774474103 None] Delete group completed successfully.
Apr 17 05:28:56 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef" returned: 0 in 0.882s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:56 devstack sudo[85373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef
Apr 17 05:28:56 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:57 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-065cc777-0245-4b93-8740-dd4a937dd2ef" returned: 0 in 0.743s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "cinder-quobyte-065cc777-0245-4b93-8740-dd4a937dd2ef" released by "delete_volume" :: held 1.671s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:57 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:UPDATE=116,cinder:SELECT=137,cinder:INSERT=43,cinder:DELETE=5 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:28:57 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Created reservations ['5bf86d35-91c1-4b02-8417-7576a9020367', '2cea1f61-379a-48b4-85af-fb40e7588674', '602cbc2a-feca-4774-a682-d64cfd7a17cc', '0b234a6d-715d-45a1-b520-24aae6487f62'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:28:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:57 devstack sudo[85378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:28:57 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:58 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.677s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:28:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Deleted volume successfully.
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-393ff3b6-48e2-47fe-a558-3463dd473911 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "cinder-065cc777-0245-4b93-8740-dd4a937dd2ef-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Flow 'volume_create_manager' (6ceebd14-4aeb-4947-8ee2-d7653042665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb399c3-8028-44ce-9ed4-9abd51f0316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb399c3-8028-44ce-9ed4-9abd51f0316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-103603331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b232a4-a2aa-49e4-b76d-0d2670729c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca246cf318c44fcafa9c53966f86b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:58Z,use_quota=True,user_id='277fa676af9a4c4f965f0db9306328e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e96a5e5-9624-4289-9548-cee6444b5cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e96a5e5-9624-4289-9548-cee6444b5cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec00289-1f48-4ce4-ab8b-32db22e7248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec00289-1f48-4ce4-ab8b-32db22e7248b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b232a4-a2aa-49e4-b76d-0d2670729c7e', 'volume_name': 'volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a487b5ba-efe3-42e8-8e6f-47fd19945e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a487b5ba-efe3-42e8-8e6f-47fd19945e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfd5928-1270-4687-9032-3bd3163de19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:58 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Volume b8b232a4-a2aa-49e4-b76d-0d2670729c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e', 'volume_size': 1}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-103603331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b232a4-a2aa-49e4-b76d-0d2670729c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca246cf318c44fcafa9c53966f86b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:28:58Z,use_quota=True,user_id='277fa676af9a4c4f965f0db9306328e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Creating volume b8b232a4-a2aa-49e4-b76d-0d2670729c7e {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:28:58 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:28:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:58 devstack sudo[85382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e 1073741824
Apr 17 05:28:58 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:59 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e 1073741824" returned: 0 in 0.627s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:59 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=153,cinder:INSERT=31,cinder:UPDATE=175,cinder:DELETE=6 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:28:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:28:59 devstack sudo[85411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e
Apr 17 05:28:59 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:28:59 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root
Apr 17 05:28:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e" returned: 0 in 0.752s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:28:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:28:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:28:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfd5928-1270-4687-9032-3bd3163de19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2626952-def9-4bcd-887f-8d5b52c2edfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:28:59 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Volume volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e (b8b232a4-a2aa-49e4-b76d-0d2670729c7e): created successfully
Apr 17 05:28:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2626952-def9-4bcd-887f-8d5b52c2edfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:28:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Flow 'volume_create_manager' (6ceebd14-4aeb-4947-8ee2-d7653042665d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:28:59 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-beef380c-79f7-4240-8e1b-2bf11f5c8185 tempest-VolumeQuotasAdminTestJSON-1693456341 None] Created volume successfully.
Apr 17 05:29:01 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-2a5ce4a5-d942-4e71-94d5-40401d665f61 tempest-VolumeQuotasAdminTestJSON-1941458050 None] Transfer volume completed successfully.
Apr 17 05:29:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Acquiring lock "cinder-b8b232a4-a2aa-49e4-b76d-0d2670729c7e-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Lock "cinder-b8b232a4-a2aa-49e4-b76d-0d2670729c7e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Acquiring lock "cinder-quobyte-b8b232a4-a2aa-49e4-b76d-0d2670729c7e" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Lock "cinder-quobyte-b8b232a4-a2aa-49e4-b76d-0d2670729c7e" acquired by "delete_volume" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:02 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bf4fb6-abc1-4b70-8552-129a4d7dbdc1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:02 devstack sudo[85497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e
Apr 17 05:29:02 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:03 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e" returned: 0 in 0.574s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:03 devstack sudo[85502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e
Apr 17 05:29:03 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:03 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b8b232a4-a2aa-49e4-b76d-0d2670729c7e" returned: 0 in 0.536s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Lock "cinder-quobyte-b8b232a4-a2aa-49e4-b76d-0d2670729c7e" released by "delete_volume" :: held 1.173s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Created reservations ['12b0177f-05e6-4721-b54f-c8738d687959', '1ab50fac-6da5-4cdd-ad35-c13b687f1ee9', 'eeda0627-d83f-4269-944c-3efdd43feeb9', '92058049-9eed-4e49-9cf6-30d6fce355bf'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:03 devstack sudo[85506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:29:03 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:04 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.580s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:04 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:29:04 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Deleted volume successfully.
Apr 17 05:29:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-41ab19be-52fa-42c9-8766-04fed6a63a50 tempest-VolumeQuotasAdminTestJSON-1698523385 None] Lock "cinder-b8b232a4-a2aa-49e4-b76d-0d2670729c7e-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c5bc97ab-c91d-4d06-9f26-228df2c65ae8 tempest-GroupsTest-2116482359 None] Group tempest-Group1-1244045669: creating
Apr 17 05:29:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c5bc97ab-c91d-4d06-9f26-228df2c65ae8 tempest-GroupsTest-2116482359 None] Group tempest-Group1-1244045669: created successfully
Apr 17 05:29:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c5bc97ab-c91d-4d06-9f26-228df2c65ae8 tempest-GroupsTest-2116482359 None] Create group completed successfully.
Apr 17 05:29:07 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9110bbbd-f37e-442a-b163-a4cf7afdc7c3 tempest-GroupsTest-2116482359 None] Group tempest-Group2-1278356791: creating
Apr 17 05:29:07 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9110bbbd-f37e-442a-b163-a4cf7afdc7c3 tempest-GroupsTest-2116482359 None] Group tempest-Group2-1278356791: created successfully
Apr 17 05:29:07 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9110bbbd-f37e-442a-b163-a4cf7afdc7c3 tempest-GroupsTest-2116482359 None] Create group completed successfully.
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Flow 'volume_create_manager' (36f3db81-55b5-48a2-949c-d23ddde8d93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbf1442-5660-45d0-8962-02be8b7df0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbf1442-5660-45d0-8962-02be8b7df0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-240922647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ff19b271-3fa5-4441-b2d3-a03c254d346c,host='devstack@QuobyteHD#QuobyteHD',id=56d1b6f8-11c0-4d56-9c34-028a3bd8faca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce68ecc4303c43c1a88bd04564828476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:09Z,use_quota=True,user_id='d09a8cd9109d43899bce581b5df4dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0adac65d-fa36-444a-a7be-642e09ddcccc),volume_type_id=0adac65d-fa36-444a-a7be-642e09ddcccc)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33393af5-0030-46a2-8d57-e7933da3bc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33393af5-0030-46a2-8d57-e7933da3bc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66fb210-dd53-4db6-9761-bfe0ddf69e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66fb210-dd53-4db6-9761-bfe0ddf69e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d1b6f8-11c0-4d56-9c34-028a3bd8faca', 'volume_name': 'volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9dcd46-6026-400c-a4fb-af466fefc780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9dcd46-6026-400c-a4fb-af466fefc780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ded55cc-24e6-4180-baac-b1d617df68b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:08 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Volume 56d1b6f8-11c0-4d56-9c34-028a3bd8faca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca', 'volume_size': 1}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ff19b271-3fa5-4441-b2d3-a03c254d346c,created_at=2026-04-17T03:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-240922647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ff19b271-3fa5-4441-b2d3-a03c254d346c,host='devstack@QuobyteHD#QuobyteHD',id=56d1b6f8-11c0-4d56-9c34-028a3bd8faca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce68ecc4303c43c1a88bd04564828476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:09Z,use_quota=True,user_id='d09a8cd9109d43899bce581b5df4dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0adac65d-fa36-444a-a7be-642e09ddcccc),volume_type_id=0adac65d-fa36-444a-a7be-642e09ddcccc)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Creating volume 56d1b6f8-11c0-4d56-9c34-028a3bd8faca {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:29:08 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:29:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:08 devstack sudo[85522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca 1073741824
Apr 17 05:29:08 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:09 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca 1073741824" returned: 0 in 0.565s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:09 devstack sudo[85527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca
Apr 17 05:29:09 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Flow 'volume_create_manager' (bbde35e5-50c6-46f3-b70a-7a102e9e7f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0748a0ab-6962-4720-9abe-3b3b9649b6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0748a0ab-6962-4720-9abe-3b3b9649b6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1038372748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e464d24a-6cc0-40c0-b355-b2f244c7e3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51f533b03f84fe99c6eeca0beae29f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:10Z,use_quota=True,user_id='b5b5d75957384f37a2ae140b10899830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(481e16f3-1900-4972-8ec2-b0befbe85413),volume_type_id=481e16f3-1900-4972-8ec2-b0befbe85413)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce063c9-b7d7-4150-824f-b96ae21f43e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce063c9-b7d7-4150-824f-b96ae21f43e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebe5257-9067-4d9b-8dee-0715b0b20b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebe5257-9067-4d9b-8dee-0715b0b20b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e464d24a-6cc0-40c0-b355-b2f244c7e3d8', 'volume_name': 'volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938e3bf9-dd7e-4b7c-b2e2-39f78d30b28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938e3bf9-dd7e-4b7c-b2e2-39f78d30b28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340571a3-3ff1-4cdc-b7d7-3fd00fa345b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:09 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Volume e464d24a-6cc0-40c0-b355-b2f244c7e3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8', 'volume_size': 1}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:09 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca" returned: 0 in 0.457s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1038372748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e464d24a-6cc0-40c0-b355-b2f244c7e3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51f533b03f84fe99c6eeca0beae29f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:10Z,use_quota=True,user_id='b5b5d75957384f37a2ae140b10899830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(481e16f3-1900-4972-8ec2-b0befbe85413),volume_type_id=481e16f3-1900-4972-8ec2-b0befbe85413)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Creating volume e464d24a-6cc0-40c0-b355-b2f244c7e3d8 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:29:09 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ded55cc-24e6-4180-baac-b1d617df68b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:09 devstack sudo[85530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8 1073741824
Apr 17 05:29:09 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72694284-263a-4fef-b3b5-76b706deff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:09 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Volume volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca (56d1b6f8-11c0-4d56-9c34-028a3bd8faca): created successfully
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72694284-263a-4fef-b3b5-76b706deff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Flow 'volume_create_manager' (36f3db81-55b5-48a2-949c-d23ddde8d93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:09 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-48885153-319d-4ff0-a183-a53cb04009b0 tempest-GroupsTest-2116482359 None] Created volume successfully.
Apr 17 05:29:10 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8 1073741824" returned: 0 in 0.505s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:10 devstack sudo[85535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8
Apr 17 05:29:10 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:10 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8" returned: 0 in 0.467s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:29:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340571a3-3ff1-4cdc-b7d7-3fd00fa345b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f76db5-ab09-4a7f-a9e8-0c90beb740a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:10 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Volume volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8 (e464d24a-6cc0-40c0-b355-b2f244c7e3d8): created successfully
Apr 17 05:29:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f76db5-ab09-4a7f-a9e8-0c90beb740a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Flow 'volume_create_manager' (bbde35e5-50c6-46f3-b70a-7a102e9e7f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:10 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-becb2331-2982-4950-907a-b79cb5ba8005 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Created volume successfully.
Apr 17 05:29:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Acquiring lock "cinder-quobyte-56d1b6f8-11c0-4d56-9c34-028a3bd8faca" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Lock "cinder-quobyte-56d1b6f8-11c0-4d56-9c34-028a3bd8faca" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:11 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f1e651-866d-4d08-ae0e-3cb06f04a8bd]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:11 devstack sudo[85538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca
Apr 17 05:29:11 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:11 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca" returned: 0 in 0.630s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:11 devstack sudo[85543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca
Apr 17 05:29:11 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cffa2ef8-2ba4-49e6-bcef-cedf99165407 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cffa2ef8-2ba4-49e6-bcef-cedf99165407 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cffa2ef8-2ba4-49e6-bcef-cedf99165407 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cffa2ef8-2ba4-49e6-bcef-cedf99165407 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cffa2ef8-2ba4-49e6-bcef-cedf99165407 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cffa2ef8-2ba4-49e6-bcef-cedf99165407 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:12 devstack sudo[85545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:29:12 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:12 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-56d1b6f8-11c0-4d56-9c34-028a3bd8faca" returned: 0 in 0.746s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Lock "cinder-quobyte-56d1b6f8-11c0-4d56-9c34-028a3bd8faca" released by "delete_volume" :: held 1.404s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:12 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cffa2ef8-2ba4-49e6-bcef-cedf99165407 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.540s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-cffa2ef8-2ba4-49e6-bcef-cedf99165407 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:29:12 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-cffa2ef8-2ba4-49e6-bcef-cedf99165407 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Retype volume completed successfully.
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Created reservations ['936faa2c-0b9f-4c16-a4be-0f1aa4b3c22a'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:12 devstack cinder-volume[82266]: WARNING cinder.quota [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-724599346 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-724599346, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:29:12 devstack cinder-volume[82266]: WARNING cinder.quota [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-724599346 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-724599346, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Created reservations ['db4eb4b2-ace9-4360-84a0-c28166e9a521', '22d0c7c7-0997-4bef-b1c6-fad709a92e46', '53523ae3-bb4c-43eb-bd81-df90d7d514da', '437ff809-2dea-46f6-9c1e-7b802171e4b3'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:12 devstack sudo[85567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:29:12 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:13 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.570s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:29:13 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4ee64dad-ddc8-4888-afec-b2beeef220ee tempest-GroupsTest-2116482359 None] Delete group completed successfully.
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Acquiring lock "cinder-e464d24a-6cc0-40c0-b355-b2f244c7e3d8-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "cinder-e464d24a-6cc0-40c0-b355-b2f244c7e3d8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Acquiring lock "cinder-quobyte-e464d24a-6cc0-40c0-b355-b2f244c7e3d8" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "cinder-quobyte-e464d24a-6cc0-40c0-b355-b2f244c7e3d8" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f669bd4-3aea-465a-b446-fbf184902bd4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:13 devstack sudo[85577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8
Apr 17 05:29:13 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-111bcf0d-1f29-457d-bb25-ccd994f40c41 tempest-GroupsTest-2116482359 None] Created reservations ['8b3bc682-6c06-416a-9549-f82b11e5a240'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-111bcf0d-1f29-457d-bb25-ccd994f40c41 tempest-GroupsTest-2116482359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-111bcf0d-1f29-457d-bb25-ccd994f40c41 tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-111bcf0d-1f29-457d-bb25-ccd994f40c41 tempest-GroupsTest-2116482359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-111bcf0d-1f29-457d-bb25-ccd994f40c41 tempest-GroupsTest-2116482359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-111bcf0d-1f29-457d-bb25-ccd994f40c41 tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-111bcf0d-1f29-457d-bb25-ccd994f40c41 tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:13 devstack sudo[85579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:29:13 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:14 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-111bcf0d-1f29-457d-bb25-ccd994f40c41 tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.503s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-111bcf0d-1f29-457d-bb25-ccd994f40c41 tempest-GroupsTest-2116482359 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:29:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-111bcf0d-1f29-457d-bb25-ccd994f40c41 tempest-GroupsTest-2116482359 None] Delete group completed successfully.
Apr 17 05:29:14 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8" returned: 0 in 0.681s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:14 devstack sudo[85587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8
Apr 17 05:29:14 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:14 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e464d24a-6cc0-40c0-b355-b2f244c7e3d8" returned: 0 in 0.430s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "cinder-quobyte-e464d24a-6cc0-40c0-b355-b2f244c7e3d8" released by "delete_volume" :: held 1.134s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:14 devstack cinder-volume[82266]: WARNING cinder.quota [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:29:14 devstack cinder-volume[82266]: WARNING cinder.quota [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Created reservations ['06b0b026-40e4-43a3-aef8-e6ab1698cc62', '2482677b-434b-4905-8041-1de1be1606ad', 'e79f075f-f295-4e2a-9119-c84c32aea182', '31b23c32-ba68-435c-96e7-601854eef1d5'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:14 devstack sudo[85598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:29:14 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e6450b71-124c-468c-8f50-b5264c2f65a0 tempest-GroupsTest-2116482359 None] Group tempest-GroupsTest-Group-554165034: creating
Apr 17 05:29:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e6450b71-124c-468c-8f50-b5264c2f65a0 tempest-GroupsTest-2116482359 None] Group tempest-GroupsTest-Group-554165034: created successfully
Apr 17 05:29:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e6450b71-124c-468c-8f50-b5264c2f65a0 tempest-GroupsTest-2116482359 None] Create group completed successfully.
Apr 17 05:29:15 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.613s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:15 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:29:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Deleted volume successfully.
Apr 17 05:29:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f428fea4-4f8a-40a5-b200-b4bac342c164 tempest-VolumeRetypeWithoutMigrationTest-1937361835 None] Lock "cinder-e464d24a-6cc0-40c0-b355-b2f244c7e3d8-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Flow 'volume_create_manager' (48e16bdf-198d-4509-9c7e-c6f00a854516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf566c2c-c129-4065-9183-0c58783ded63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf566c2c-c129-4065-9183-0c58783ded63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1000923814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9489e933-f1e2-4fee-8dbd-d746e0debb1a,host='devstack@QuobyteHD#QuobyteHD',id=19ec4c5c-6835-4cc2-912c-e8523619693c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce68ecc4303c43c1a88bd04564828476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:16Z,use_quota=True,user_id='d09a8cd9109d43899bce581b5df4dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72da2c29-27a7-4deb-ae3c-96f2f67f85f0),volume_type_id=72da2c29-27a7-4deb-ae3c-96f2f67f85f0)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f64e86-ce6f-4d03-abeb-13ed52fadb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f64e86-ce6f-4d03-abeb-13ed52fadb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dddc71b4-cf94-4aa8-abbd-cba59ce080be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dddc71b4-cf94-4aa8-abbd-cba59ce080be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ec4c5c-6835-4cc2-912c-e8523619693c', 'volume_name': 'volume-19ec4c5c-6835-4cc2-912c-e8523619693c', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9af7acb-6de5-4750-8de9-bd87f03ef9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9af7acb-6de5-4750-8de9-bd87f03ef9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66862b0d-5326-4a5a-94c2-04c4a5c72c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:16 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Volume 19ec4c5c-6835-4cc2-912c-e8523619693c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ec4c5c-6835-4cc2-912c-e8523619693c', 'volume_size': 1}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9489e933-f1e2-4fee-8dbd-d746e0debb1a,created_at=2026-04-17T03:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1000923814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9489e933-f1e2-4fee-8dbd-d746e0debb1a,host='devstack@QuobyteHD#QuobyteHD',id=19ec4c5c-6835-4cc2-912c-e8523619693c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce68ecc4303c43c1a88bd04564828476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:16Z,use_quota=True,user_id='d09a8cd9109d43899bce581b5df4dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72da2c29-27a7-4deb-ae3c-96f2f67f85f0),volume_type_id=72da2c29-27a7-4deb-ae3c-96f2f67f85f0)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Creating volume 19ec4c5c-6835-4cc2-912c-e8523619693c {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:29:16 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:29:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:16 devstack sudo[85637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c 1073741824
Apr 17 05:29:16 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:17 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c 1073741824" returned: 0 in 0.942s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:17 devstack sudo[85649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c
Apr 17 05:29:17 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:18 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c" returned: 0 in 0.595s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:29:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66862b0d-5326-4a5a-94c2-04c4a5c72c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ec4c5c-6835-4cc2-912c-e8523619693c', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaaece33-21bb-4e88-9d13-df7f707c3b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:18 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Volume volume-19ec4c5c-6835-4cc2-912c-e8523619693c (19ec4c5c-6835-4cc2-912c-e8523619693c): created successfully
Apr 17 05:29:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaaece33-21bb-4e88-9d13-df7f707c3b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Flow 'volume_create_manager' (48e16bdf-198d-4509-9c7e-c6f00a854516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:18 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-771f2cb6-d17c-4d58-afb2-5c4083dc83de tempest-GroupsTest-2116482359 None] Created volume successfully.
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Flow 'volume_create_manager' (c2822255-0ab1-4a9a-929c-51c0b6174b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b6b9bd-5cbd-43df-9665-86c7dd1edd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b6b9bd-5cbd-43df-9665-86c7dd1edd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903857812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9489e933-f1e2-4fee-8dbd-d746e0debb1a,host='devstack@QuobyteHD#QuobyteHD',id=20ae8dee-29ab-467a-b145-12e3ba0002a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce68ecc4303c43c1a88bd04564828476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:19Z,use_quota=True,user_id='d09a8cd9109d43899bce581b5df4dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72da2c29-27a7-4deb-ae3c-96f2f67f85f0),volume_type_id=72da2c29-27a7-4deb-ae3c-96f2f67f85f0)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4c5fb6-c573-4bad-be71-1f09f1ba6e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4c5fb6-c573-4bad-be71-1f09f1ba6e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004dc330-42c9-45b9-9247-007c789e7c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004dc330-42c9-45b9-9247-007c789e7c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ae8dee-29ab-467a-b145-12e3ba0002a9', 'volume_name': 'volume-20ae8dee-29ab-467a-b145-12e3ba0002a9', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9e6094-4027-4392-833a-a2c3e4a0210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9e6094-4027-4392-833a-a2c3e4a0210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ddbfde-25b1-4601-8942-91504faa6a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:19 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Volume 20ae8dee-29ab-467a-b145-12e3ba0002a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ae8dee-29ab-467a-b145-12e3ba0002a9', 'volume_size': 1}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9489e933-f1e2-4fee-8dbd-d746e0debb1a,created_at=2026-04-17T03:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903857812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9489e933-f1e2-4fee-8dbd-d746e0debb1a,host='devstack@QuobyteHD#QuobyteHD',id=20ae8dee-29ab-467a-b145-12e3ba0002a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce68ecc4303c43c1a88bd04564828476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:19Z,use_quota=True,user_id='d09a8cd9109d43899bce581b5df4dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72da2c29-27a7-4deb-ae3c-96f2f67f85f0),volume_type_id=72da2c29-27a7-4deb-ae3c-96f2f67f85f0)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Creating volume 20ae8dee-29ab-467a-b145-12e3ba0002a9 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:29:19 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:29:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:19 devstack sudo[85677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9 1073741824
Apr 17 05:29:19 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:20 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9 1073741824" returned: 0 in 0.941s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:20 devstack sudo[85685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9
Apr 17 05:29:20 devstack sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:21 devstack sudo[85685]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9" returned: 0 in 0.869s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:29:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ddbfde-25b1-4601-8942-91504faa6a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ae8dee-29ab-467a-b145-12e3ba0002a9', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848cd079-0f6d-4dc8-be22-7d751ba08a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:21 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Volume volume-20ae8dee-29ab-467a-b145-12e3ba0002a9 (20ae8dee-29ab-467a-b145-12e3ba0002a9): created successfully
Apr 17 05:29:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848cd079-0f6d-4dc8-be22-7d751ba08a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Flow 'volume_create_manager' (c2822255-0ab1-4a9a-929c-51c0b6174b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:21 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4172474b-f64b-4275-9518-8f110c1692df tempest-GroupsTest-2116482359 None] Created volume successfully.
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Flow 'volume_create_manager' (786412bc-9c7e-43bb-a4dc-5416da5aec6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6737a440-11d0-43ed-8293-159faf26b18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6737a440-11d0-43ed-8293-159faf26b18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1777273018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e709cb-54e4-4f1f-90b2-32c60d54bffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c5466e81eb4c229d79958ab2eeee08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:22Z,use_quota=True,user_id='8acba3ea16b04a6da18f64307d8b1600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad8d3be-8142-4dc4-ba6c-e005bb8ca511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad8d3be-8142-4dc4-ba6c-e005bb8ca511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238cde37-f6c4-4362-98e0-695b40c85cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.image.glance [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Creating Keystone auth plugin from conf {{(pid=82266) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 17 05:29:22 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ba99a1f6-9abb-449f-8e1b-4912d92d5fa0 tempest-GroupsTest-2116482359 None] Update group completed successfully.
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238cde37-f6c4-4362-98e0-695b40c85cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93e709cb-54e4-4f1f-90b2-32c60d54bffe', 'volume_name': 'volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536d851f60>}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba07ec49-67f7-492c-ae8a-42c5fadb7244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba07ec49-67f7-492c-ae8a-42c5fadb7244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada1e878-1355-47d5-8229-c8c98606be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:22 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Volume 93e709cb-54e4-4f1f-90b2-32c60d54bffe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536d851f60>}
Apr 17 05:29:22 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Trying to clone 93e709cb-54e4-4f1f-90b2-32c60d54bffe from image f11dd628-d05d-412e-b4ef-be70c4399345 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]). {{(pid=82266) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 17 05:29:23 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 17 05:29:23 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Image download 20.69 MB at 20.69 MB/s
Apr 17 05:29:23 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e6dcb8-b3ed-4481-b940-80f47d5f8fae]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:23 devstack sudo[85717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD
Apr 17 05:29:23 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:23 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD" returned: 0 in 0.564s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:23 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Temporary image f11dd628-d05d-412e-b4ef-be70c4399345 is fetched for user 8acba3ea16b04a6da18f64307d8b1600. {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 17 05:29:23 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08fc8aa-e629-4472-8159-eef753fd3ec4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:23 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-282c2062-9a7b-40c6-bff9-bdf37b0593f4 tempest-GroupsTest-2116482359 None] Update group completed successfully.
Apr 17 05:29:24 devstack sudo[85723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD
Apr 17 05:29:24 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:24 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD" returned: 0 in 0.604s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1777273018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e709cb-54e4-4f1f-90b2-32c60d54bffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c5466e81eb4c229d79958ab2eeee08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:22Z,use_quota=True,user_id='8acba3ea16b04a6da18f64307d8b1600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Creating volume 93e709cb-54e4-4f1f-90b2-32c60d54bffe {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:29:24 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:29:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:24 devstack sudo[85746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe 1073741824
Apr 17 05:29:24 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:25 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe 1073741824" returned: 0 in 0.706s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:25 devstack sudo[85756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe
Apr 17 05:29:25 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Acquiring lock "cinder-quobyte-19ec4c5c-6835-4cc2-912c-e8523619693c" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Lock "cinder-quobyte-19ec4c5c-6835-4cc2-912c-e8523619693c" acquired by "delete_volume" :: waited 0.021s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:25 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[92037e76-96a1-412a-a3a4-e13477026f3c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:25 devstack sudo[85758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c
Apr 17 05:29:25 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:25 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe" returned: 0 in 0.639s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:29:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:25 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Attempting download of f11dd628-d05d-412e-b4ef-be70c4399345 ((None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}])) to volume 93e709cb-54e4-4f1f-90b2-32c60d54bffe. {{(pid=82266) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 17 05:29:26 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[857dc2dc-ac57-4940-9ac7-81f708b4c60e]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pkhj4gbr {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:26 devstack sudo[85761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pkhj4gbr
Apr 17 05:29:26 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:26 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c" returned: 0 in 0.872s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:26 devstack sudo[85766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c
Apr 17 05:29:26 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:26 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pkhj4gbr" returned: 0 in 0.840s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pkhj4gbr {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:26 devstack sudo[85770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pkhj4gbr
Apr 17 05:29:26 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:27 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-19ec4c5c-6835-4cc2-912c-e8523619693c" returned: 0 in 0.919s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Lock "cinder-quobyte-19ec4c5c-6835-4cc2-912c-e8523619693c" released by "delete_volume" :: held 1.953s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Acquiring lock "cinder-quobyte-20ae8dee-29ab-467a-b145-12e3ba0002a9" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Lock "cinder-quobyte-20ae8dee-29ab-467a-b145-12e3ba0002a9" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:27 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[860287bb-cdbb-443d-830b-daa9ff5dde01]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:27 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pkhj4gbr" returned: 1 in 0.650s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pkhj4gbr' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:29:27 devstack sudo[85775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9
Apr 17 05:29:27 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:27 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[85200559-a996-43ab-aa63-36c44a76d694]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:27 devstack sudo[85778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD
Apr 17 05:29:27 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:28 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9" returned: 0 in 1.016s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:28 devstack sudo[85786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9
Apr 17 05:29:28 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:28 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD" returned: 0 in 1.114s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:28 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] f11dd628-d05d-412e-b4ef-be70c4399345 was qcow2, converting to raw {{(pid=82266) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 17 05:29:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:28 devstack sudo[85789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe
Apr 17 05:29:28 devstack sudo[85789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:29 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20ae8dee-29ab-467a-b145-12e3ba0002a9" returned: 0 in 1.024s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Lock "cinder-quobyte-20ae8dee-29ab-467a-b145-12e3ba0002a9" released by "delete_volume" :: held 2.099s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:29 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Created reservations ['bd576935-6b6a-435b-b70f-1ec1bc0d1697'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:29 devstack cinder-volume[82266]: WARNING cinder.quota [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-610638382 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-610638382, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:29:29 devstack cinder-volume[82266]: WARNING cinder.quota [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-610638382 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-610638382, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:29:29 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Created reservations ['e130b3b4-5133-4815-a1cc-8d59d41b190b', 'eab1c4df-5c5d-46ad-9110-345a5dc19701', '54660a1f-fabf-43dd-9a22-4a768f0ca4b8', 'e2b079f0-83dd-4fb4-83d8-ea80e7a1761a'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:29 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Created reservations ['24523c4b-cd3c-4161-86e2-893d673a1992', '19e3edfe-21bf-4f19-b29e-ea8f7e452366', 'd2367a21-4113-4122-8cc8-0cf21ac364bf', 'a3bd28fc-97d3-40e0-9c4f-67aa6a570f87'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:30 devstack sudo[85802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:29:30 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:31 devstack sudo[85789]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe" returned: 0 in 2.466s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:31 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_o5pdbcg0devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:29:31 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Converted 112.00 MB image at 45.40 MB/s
Apr 17 05:29:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:31 devstack sudo[85821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe 1G
Apr 17 05:29:31 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:31 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 1.489s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:31 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:29:31 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d3572817-53c2-4b22-82dc-f2d364b48984 tempest-GroupsTest-2116482359 None] Delete group completed successfully.
Apr 17 05:29:31 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe 1G" returned: 0 in 0.751s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:31 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaf2607-a33f-4682-821f-640d9bcad5dd]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:31 devstack sudo[85828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe
Apr 17 05:29:31 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:32 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe" returned: 0 in 0.812s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:32 devstack sudo[85832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe
Apr 17 05:29:32 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:33 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe" returned: 1 in 0.906s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Downloaded image f11dd628-d05d-412e-b4ef-be70c4399345 ((None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}])) to volume 93e709cb-54e4-4f1f-90b2-32c60d54bffe successfully. {{(pid=82266) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Temporary image f11dd628-d05d-412e-b4ef-be70c4399345 for user 8acba3ea16b04a6da18f64307d8b1600 is deleted. {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Marking volume 93e709cb-54e4-4f1f-90b2-32c60d54bffe as bootable. {{(pid=82266) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Copying metadata from image f11dd628-d05d-412e-b4ef-be70c4399345 to 93e709cb-54e4-4f1f-90b2-32c60d54bffe. {{(pid=82266) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Creating volume glance metadata for volume 93e709cb-54e4-4f1f-90b2-32c60d54bffe backed by image f11dd628-d05d-412e-b4ef-be70c4399345 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82266) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada1e878-1355-47d5-8229-c8c98606be60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536d851f60>}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bafb057-1682-4c21-a80f-a2a1ac41955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:33 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Volume volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe (93e709cb-54e4-4f1f-90b2-32c60d54bffe): created successfully
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bafb057-1682-4c21-a80f-a2a1ac41955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Flow 'volume_create_manager' (786412bc-9c7e-43bb-a4dc-5416da5aec6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e71c5ea2-f594-42fa-b4a0-67b94f35725d tempest-VolumesImageMetadata-761857860 None] Created volume successfully.
Apr 17 05:29:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Acquiring lock "cinder-93e709cb-54e4-4f1f-90b2-32c60d54bffe-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Lock "cinder-93e709cb-54e4-4f1f-90b2-32c60d54bffe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Acquiring lock "cinder-quobyte-93e709cb-54e4-4f1f-90b2-32c60d54bffe" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Lock "cinder-quobyte-93e709cb-54e4-4f1f-90b2-32c60d54bffe" acquired by "delete_volume" :: waited 0.014s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:35 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c853aff2-6fa9-43e7-82c6-67cd5b03cffe]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:35 devstack sudo[85840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe
Apr 17 05:29:35 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:35 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe" returned: 0 in 0.565s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:36 devstack sudo[85844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe
Apr 17 05:29:36 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:37 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe" returned: 1 in 1.364s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:29:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:37 devstack sudo[85879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe
Apr 17 05:29:37 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:38 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:29:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Flow 'volume_create_manager' (d04db627-703d-413e-8687-7386c80116a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4580ed-7f60-4d2e-a69d-a348a66e5bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4580ed-7f60-4d2e-a69d-a348a66e5bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a10a34-6791-4c12-a586-dd66b9957094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edaceaad1fcd4ecb8bdf15919b110a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:39Z,use_quota=True,user_id='baaf40a28d154d7ca0dc70948794dd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49b40c3-00ec-4eec-98ae-60a0d8a48bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49b40c3-00ec-4eec-98ae-60a0d8a48bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:39 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab3448b-3211-416b-afe9-7df835b11bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.image.glance [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Creating Keystone auth plugin from conf {{(pid=82266) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93e709cb-54e4-4f1f-90b2-32c60d54bffe" returned: 0 in 1.788s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Lock "cinder-quobyte-93e709cb-54e4-4f1f-90b2-32c60d54bffe" released by "delete_volume" :: held 3.830s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Created reservations ['ce79f997-8884-40b6-a7ca-5aa5e946f45a', 'b1ee7524-b632-44e5-b64d-12e92d58eab2', 'a389e1fb-5b77-4a25-a183-40c88cd79752', 'fd7ff798-01d1-4983-829d-5f1a806139c9'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:39 devstack sudo[85886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:29:39 devstack sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab3448b-3211-416b-afe9-7df835b11bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '20a10a34-6791-4c12-a586-dd66b9957094', 'volume_name': 'volume-20a10a34-6791-4c12-a586-dd66b9957094', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536dd0e290>}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b5184a-e78d-4385-b39a-cc7c35fd5f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b5184a-e78d-4385-b39a-cc7c35fd5f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8530bb4-ba92-4f21-a4aa-467ca9d96738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:39 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Volume 20a10a34-6791-4c12-a586-dd66b9957094: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-20a10a34-6791-4c12-a586-dd66b9957094', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536dd0e290>}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Trying to clone 20a10a34-6791-4c12-a586-dd66b9957094 from image f11dd628-d05d-412e-b4ef-be70c4399345 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]). {{(pid=82266) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 17 05:29:39 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 17 05:29:39 devstack cinder-volume[82266]: INFO cinder.image.image_utils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Image download 20.69 MB at 20.69 MB/s
Apr 17 05:29:40 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[685d2e96-8584-4278-8414-c7131277d988]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:40 devstack sudo[85908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD
Apr 17 05:29:40 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:40 devstack sudo[85886]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 1.272s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:40 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:29:40 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Deleted volume successfully.
Apr 17 05:29:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f3377e3a-83ed-41b8-966c-db9f76fac3b5 tempest-VolumesImageMetadata-761857860 None] Lock "cinder-93e709cb-54e4-4f1f-90b2-32c60d54bffe-delete_volume" released by "delete_volume" :: held 5.366s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:41 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD" returned: 0 in 1.475s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:41 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Temporary image f11dd628-d05d-412e-b4ef-be70c4399345 is fetched for user baaf40a28d154d7ca0dc70948794dd1a. {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 17 05:29:41 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71467a3-a24f-4fc2-b6ca-2e69df1fd288]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:41 devstack sudo[85963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD
Apr 17 05:29:41 devstack sudo[85963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:42 devstack sudo[85963]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD" returned: 0 in 1.158s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a10a34-6791-4c12-a586-dd66b9957094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edaceaad1fcd4ecb8bdf15919b110a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:39Z,use_quota=True,user_id='baaf40a28d154d7ca0dc70948794dd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Creating volume 20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:29:42 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:29:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:42 devstack sudo[85971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 1073741824
Apr 17 05:29:42 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:43 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 1073741824" returned: 0 in 0.924s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:43 devstack sudo[85978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094
Apr 17 05:29:43 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:44 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094" returned: 0 in 0.765s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:44 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:29:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:44 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Attempting download of f11dd628-d05d-412e-b4ef-be70c4399345 ((None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}])) to volume 20a10a34-6791-4c12-a586-dd66b9957094. {{(pid=82266) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 17 05:29:44 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d75a95-5e5d-4cdc-b467-427daa247076]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pb5zr66i {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:44 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pb5zr66i
Apr 17 05:29:44 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:45 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pb5zr66i" returned: 0 in 1.133s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pb5zr66i {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:45 devstack sudo[85988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pb5zr66i
Apr 17 05:29:45 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:46 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pb5zr66i" returned: 1 in 0.867s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_pb5zr66i' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:29:46 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8946ab-c0be-456a-bdc1-2bf947011bf3]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:46 devstack sudo[86010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD
Apr 17 05:29:46 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Flow 'volume_create_manager' (611af4eb-605a-485f-8c5b-601a89b99b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99824d42-703a-48fc-bac5-cfc8185110a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:47 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99824d42-703a-48fc-bac5-cfc8185110a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1950355076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e318141f-a889-4027-b320-ed622fd49fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73bd13b356394df994f85b5dc1b5eade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:48Z,use_quota=True,user_id='00d8910ca76c444a8872b279e2bc8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2b5354-45f2-476c-a48f-d8b2b0a02c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2b5354-45f2-476c-a48f-d8b2b0a02c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e1270b-734b-4ce0-a3ca-0480ad150aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e1270b-734b-4ce0-a3ca-0480ad150aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e318141f-a889-4027-b320-ed622fd49fbf', 'volume_name': 'volume-e318141f-a889-4027-b320-ed622fd49fbf', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6ab22d-e1ba-4124-9b1f-ebb7c2039355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6ab22d-e1ba-4124-9b1f-ebb7c2039355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b50bcb0-51ae-4051-99f8-daac5a6ec419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:47 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Volume e318141f-a889-4027-b320-ed622fd49fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e318141f-a889-4027-b320-ed622fd49fbf', 'volume_size': 1}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1950355076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e318141f-a889-4027-b320-ed622fd49fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73bd13b356394df994f85b5dc1b5eade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:48Z,use_quota=True,user_id='00d8910ca76c444a8872b279e2bc8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Creating volume e318141f-a889-4027-b320-ed622fd49fbf {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:29:47 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD" returned: 0 in 1.058s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] f11dd628-d05d-412e-b4ef-be70c4399345 was qcow2, converting to raw {{(pid=82266) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 17 05:29:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:47 devstack sudo[86032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf 1073741824
Apr 17 05:29:47 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:47 devstack sudo[86033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094
Apr 17 05:29:47 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:48 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf 1073741824" returned: 0 in 1.257s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:29:49 devstack sudo[86055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf
Apr 17 05:29:49 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Flow 'volume_create_manager' (16ea9af1-1403-4dda-9e5e-cf1dfb21f51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a0da6f-aebb-4c83-8f5a-28563e8a0adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a0da6f-aebb-4c83-8f5a-28563e8a0adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1623463265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4fa88e-9516-4032-b59f-6157e1fe1f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5701247aed41b9836ddf7c5cb9b62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:49Z,use_quota=True,user_id='3f173e32f00245609a16930030b92fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dd4ad9-6714-44d3-83f6-730f651936b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dd4ad9-6714-44d3-83f6-730f651936b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc85291-adc9-403c-8955-d97ca94ca534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc85291-adc9-403c-8955-d97ca94ca534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4fa88e-9516-4032-b59f-6157e1fe1f2f', 'volume_name': 'volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce88af74-a857-4bc9-b001-4e6f168d48b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce88af74-a857-4bc9-b001-4e6f168d48b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbc4465-d4e7-46b6-ac97-3768a4fac377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:49 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Volume de4fa88e-9516-4032-b59f-6157e1fe1f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f', 'volume_size': 1}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:49 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094" returned: 0 in 1.739s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_2uf8w3b1devstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:29:49 devstack cinder-volume[82266]: INFO cinder.image.image_utils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Converted 112.00 MB image at 64.35 MB/s
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:49 devstack sudo[86057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 1G
Apr 17 05:29:49 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:49 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf" returned: 0 in 0.806s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1623463265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4fa88e-9516-4032-b59f-6157e1fe1f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5701247aed41b9836ddf7c5cb9b62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:49Z,use_quota=True,user_id='3f173e32f00245609a16930030b92fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Creating volume de4fa88e-9516-4032-b59f-6157e1fe1f2f {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:29:49 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b50bcb0-51ae-4051-99f8-daac5a6ec419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e318141f-a889-4027-b320-ed622fd49fbf', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efc2347-83ff-43d9-b66f-87ad8238bb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:49 devstack sudo[86060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f 1073741824
Apr 17 05:29:49 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:49 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Volume volume-e318141f-a889-4027-b320-ed622fd49fbf (e318141f-a889-4027-b320-ed622fd49fbf): created successfully
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efc2347-83ff-43d9-b66f-87ad8238bb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Flow 'volume_create_manager' (611af4eb-605a-485f-8c5b-601a89b99b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:49 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-2610093d-33d5-4a00-bb6a-5d0974c7d816 tempest-VolumesServicesTestJSON-1436562888 None] Created volume successfully.
Apr 17 05:29:50 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 1G" returned: 0 in 0.909s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:50 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbe4d39-8cac-4d56-a83b-1f7ce9483f67]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:50 devstack sudo[86068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094
Apr 17 05:29:50 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:50 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f 1073741824" returned: 0 in 1.120s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:51 devstack sudo[86071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f
Apr 17 05:29:51 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:51 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Acquiring lock "cinder-e318141f-a889-4027-b320-ed622fd49fbf-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:51 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Lock "cinder-e318141f-a889-4027-b320-ed622fd49fbf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:51 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Acquiring lock "cinder-quobyte-e318141f-a889-4027-b320-ed622fd49fbf" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:51 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Lock "cinder-quobyte-e318141f-a889-4027-b320-ed622fd49fbf" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:51 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2942f090-6bd3-40d6-89fc-7f66ba50e845]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:51 devstack sudo[86074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf
Apr 17 05:29:51 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:51 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094" returned: 0 in 0.946s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:51 devstack sudo[86076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094
Apr 17 05:29:51 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:51 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf" returned: 0 in 0.794s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:52 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:52 devstack sudo[86082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f" returned: 0 in 1.038s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:52 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbc4465-d4e7-46b6-ac97-3768a4fac377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8204426f-fc49-4f4a-b648-cc6230181b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:52 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Volume volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f (de4fa88e-9516-4032-b59f-6157e1fe1f2f): created successfully
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8204426f-fc49-4f4a-b648-cc6230181b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Flow 'volume_create_manager' (16ea9af1-1403-4dda-9e5e-cf1dfb21f51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:52 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dce1934f-1563-4a05-8eaa-dc7f04eae1ac tempest-ServersNegativeTestJSON-1239533548 None] Created volume successfully.
Apr 17 05:29:52 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e318141f-a889-4027-b320-ed622fd49fbf" returned: 0 in 0.585s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Lock "cinder-quobyte-e318141f-a889-4027-b320-ed622fd49fbf" released by "delete_volume" :: held 1.414s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Created reservations ['fd319020-70d8-4044-971f-e0b143b9dd96', 'c7942cc6-9ee1-462c-b564-ee293c4eb7ad', '2bfffa9f-7b0c-4a07-891c-7a7ff3219d7c', 'afe2cf1f-bc3e-4be8-b88e-c8aec6859079'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_service.periodic_task [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:52 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094" returned: 1 in 1.510s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Downloaded image f11dd628-d05d-412e-b4ef-be70c4399345 ((None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}])) to volume 20a10a34-6791-4c12-a586-dd66b9957094 successfully. {{(pid=82266) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Temporary image f11dd628-d05d-412e-b4ef-be70c4399345 for user baaf40a28d154d7ca0dc70948794dd1a is deleted. {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Marking volume 20a10a34-6791-4c12-a586-dd66b9957094 as bootable. {{(pid=82266) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Copying metadata from image f11dd628-d05d-412e-b4ef-be70c4399345 to 20a10a34-6791-4c12-a586-dd66b9957094. {{(pid=82266) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 17 05:29:52 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Creating volume glance metadata for volume 20a10a34-6791-4c12-a586-dd66b9957094 backed by image f11dd628-d05d-412e-b4ef-be70c4399345 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82266) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 17 05:29:52 devstack sudo[86088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:29:52 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:52 devstack sudo[86089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:29:52 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8530bb4-ba92-4f21-a4aa-467ca9d96738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a10a34-6791-4c12-a586-dd66b9957094', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536dd0e290>}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6771ef-8238-483d-b1ad-ccc2209839bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:53 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Volume volume-20a10a34-6791-4c12-a586-dd66b9957094 (20a10a34-6791-4c12-a586-dd66b9957094): created successfully
Apr 17 05:29:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6771ef-8238-483d-b1ad-ccc2209839bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Flow 'volume_create_manager' (d04db627-703d-413e-8687-7386c80116a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:53 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-1c5f9800-f58a-40c6-b67c-47e6471e4374 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Created volume successfully.
Apr 17 05:29:53 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.567s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:53 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:29:53 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Deleted volume successfully.
Apr 17 05:29:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e2fc7b01-5e0e-4fe4-8cba-46ec851bf3bd tempest-VolumesServicesTestJSON-1436562888 None] Lock "cinder-e318141f-a889-4027-b320-ed622fd49fbf-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:54 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 1.445s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Flow 'volume_create_manager' (ceeb90e5-77e3-4791-8f51-715ed87edad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61fa2d42-8b69-4935-a200-09f9d12590f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61fa2d42-8b69-4935-a200-09f9d12590f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1832653666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d44b99-d41f-4c95-b590-da5131a6d8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5701247aed41b9836ddf7c5cb9b62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:55Z,use_quota=True,user_id='3f173e32f00245609a16930030b92fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5262e095-684c-435a-988e-7c59d0388c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5262e095-684c-435a-988e-7c59d0388c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e6fefa-000a-42ff-a1bd-ecad505a3754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e6fefa-000a-42ff-a1bd-ecad505a3754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d44b99-d41f-4c95-b590-da5131a6d8c0', 'volume_name': 'volume-01d44b99-d41f-4c95-b590-da5131a6d8c0', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc547ac4-ed7a-448c-b4c0-bb2a785fe68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc547ac4-ed7a-448c-b4c0-bb2a785fe68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3413d4f1-1ce5-4dd3-af36-cf28a6b47140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:54 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Volume 01d44b99-d41f-4c95-b590-da5131a6d8c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d44b99-d41f-4c95-b590-da5131a6d8c0', 'volume_size': 1}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1832653666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d44b99-d41f-4c95-b590-da5131a6d8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5701247aed41b9836ddf7c5cb9b62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:55Z,use_quota=True,user_id='3f173e32f00245609a16930030b92fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Creating volume 01d44b99-d41f-4c95-b590-da5131a6d8c0 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:29:54 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:29:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:54 devstack sudo[86102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0 1073741824
Apr 17 05:29:54 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-3fe2937a-8d00-49d7-89f6-58054ec5c9ce tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:55 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0 1073741824" returned: 0 in 0.859s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:55 devstack sudo[86107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0
Apr 17 05:29:55 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:56 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0" returned: 0 in 0.499s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:29:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-3fe2937a-8d00-49d7-89f6-58054ec5c9ce tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.324s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3413d4f1-1ce5-4dd3-af36-cf28a6b47140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d44b99-d41f-4c95-b590-da5131a6d8c0', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1f0289-8775-4bdf-9e93-584aab5f2503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:56 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d933b545-3b73-434e-a3e9-d9cef046f5e8]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-3fe2937a-8d00-49d7-89f6-58054ec5c9ce tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:56 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Volume volume-01d44b99-d41f-4c95-b590-da5131a6d8c0 (01d44b99-d41f-4c95-b590-da5131a6d8c0): created successfully
Apr 17 05:29:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1f0289-8775-4bdf-9e93-584aab5f2503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Flow 'volume_create_manager' (ceeb90e5-77e3-4791-8f51-715ed87edad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:56 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-2a8b0d73-f59c-482e-8a18-397953971046 tempest-ServersNegativeTestJSON-1239533548 None] Created volume successfully.
Apr 17 05:29:56 devstack sudo[86110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094
Apr 17 05:29:56 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:57 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-3fe2937a-8d00-49d7-89f6-58054ec5c9ce tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094" returned: 0 in 0.997s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-3fe2937a-8d00-49d7-89f6-58054ec5c9ce tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:57 devstack sudo[86115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094
Apr 17 05:29:57 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Acquiring lock "cinder-01d44b99-d41f-4c95-b590-da5131a6d8c0-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Lock "cinder-01d44b99-d41f-4c95-b590-da5131a6d8c0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:INSERT=45,cinder:UPDATE=108,cinder:SELECT=107,cinder:DELETE=7 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Acquiring lock "cinder-quobyte-01d44b99-d41f-4c95-b590-da5131a6d8c0" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Flow 'volume_create_manager' (30e341ab-1089-4f9d-83f5-e51aba5407d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1b9b64-097d-4b39-9780-3c45fba1f3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Lock "cinder-quobyte-01d44b99-d41f-4c95-b590-da5131a6d8c0" acquired by "delete_volume" :: waited 0.111s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1b9b64-097d-4b39-9780-3c45fba1f3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-217516476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0de8fd6-07be-4c3b-985a-bd94e1233369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1521041dab3a4194b7f237c18d0c1861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:58Z,use_quota=True,user_id='cf2c901345394c52beda211915926762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a724038-3e04-45bb-b7e4-800700cab3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a724038-3e04-45bb-b7e4-800700cab3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84802646-a021-41a7-b642-deee8aac6abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84802646-a021-41a7-b642-deee8aac6abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0de8fd6-07be-4c3b-985a-bd94e1233369', 'volume_name': 'volume-a0de8fd6-07be-4c3b-985a-bd94e1233369', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d98991-c276-4fec-85d6-1d4715904f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d98991-c276-4fec-85d6-1d4715904f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cfc5e6-1f27-48a7-864f-6091f49f87a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:57 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Volume a0de8fd6-07be-4c3b-985a-bd94e1233369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0de8fd6-07be-4c3b-985a-bd94e1233369', 'volume_size': 1}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[191483bb-ecd8-499e-96a9-4b84227898ed]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:58 devstack sudo[86117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0
Apr 17 05:29:58 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:58 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-3fe2937a-8d00-49d7-89f6-58054ec5c9ce tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094" returned: 1 in 0.888s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-3fe2937a-8d00-49d7-89f6-58054ec5c9ce tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-3fe2937a-8d00-49d7-89f6-58054ec5c9ce tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.923s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-217516476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0de8fd6-07be-4c3b-985a-bd94e1233369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1521041dab3a4194b7f237c18d0c1861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:29:58Z,use_quota=True,user_id='cf2c901345394c52beda211915926762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Creating volume a0de8fd6-07be-4c3b-985a-bd94e1233369 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:29:58 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:58 devstack sudo[86122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 1073741824
Apr 17 05:29:58 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-3fe2937a-8d00-49d7-89f6-58054ec5c9ce tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12', 'name': 'volume-20a10a34-6791-4c12-a586-dd66b9957094', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1649f7db-a2de-4594-8cdd-e100743ef037', 'enforce_multipath': True} {{(pid=82266) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 17 05:29:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-fc6e93df-54a3-4118-ae32-ca1ebd80b4b0 req-3fe2937a-8d00-49d7-89f6-58054ec5c9ce tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] attachment_update completed successfully.
Apr 17 05:29:58 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0" returned: 0 in 0.940s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:58 devstack sudo[86130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0
Apr 17 05:29:58 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:58 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 1073741824" returned: 0 in 0.705s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:59 devstack sudo[86132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369
Apr 17 05:29:59 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:59 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-01d44b99-d41f-4c95-b590-da5131a6d8c0" returned: 0 in 0.500s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Lock "cinder-quobyte-01d44b99-d41f-4c95-b590-da5131a6d8c0" released by "delete_volume" :: held 1.534s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:UPDATE=116,cinder:SELECT=105,cinder:INSERT=24,cinder:DELETE=8 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Created reservations ['dcb163ab-a2e5-4ec8-b806-e8d5a39557d1', '87bac05b-fe65-4587-94f6-fbae793cfa28', '6a5373b4-0e07-4101-ac7c-774dfcf36b43', '0ff8b826-a1c6-42ab-b00a-e07a030b936d'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:29:59 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369" returned: 0 in 0.532s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:29:59 devstack sudo[86136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:29:59 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cfc5e6-1f27-48a7-864f-6091f49f87a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0de8fd6-07be-4c3b-985a-bd94e1233369', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d382c10-d2b8-439f-ae85-ce5bf554c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:29:59 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Volume volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 (a0de8fd6-07be-4c3b-985a-bd94e1233369): created successfully
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d382c10-d2b8-439f-ae85-ce5bf554c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Flow 'volume_create_manager' (30e341ab-1089-4f9d-83f5-e51aba5407d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:29:59 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-6a7dc202-a02b-498c-939b-8846d2e640a9 tempest-VolumesActionsTest-730828754 None] Created volume successfully.
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Acquiring lock "cinder-de4fa88e-9516-4032-b59f-6157e1fe1f2f-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Lock "cinder-de4fa88e-9516-4032-b59f-6157e1fe1f2f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Acquiring lock "cinder-quobyte-de4fa88e-9516-4032-b59f-6157e1fe1f2f" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Lock "cinder-quobyte-de4fa88e-9516-4032-b59f-6157e1fe1f2f" acquired by "delete_volume" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d042765-6f7d-43f9-93d0-4a32cf0ae7b4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:29:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:00 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.559s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:00 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:00 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Deleted volume successfully.
Apr 17 05:30:00 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2832616b-125d-4c59-923c-d039c1ffb83e tempest-ServersNegativeTestJSON-1239533548 None] Lock "cinder-01d44b99-d41f-4c95-b590-da5131a6d8c0-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:00 devstack sudo[86139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f
Apr 17 05:30:00 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:00 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f" returned: 0 in 0.677s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:00 devstack sudo[86147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f
Apr 17 05:30:00 devstack sudo[86147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:30:01 devstack sudo[86147]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Flow 'volume_create_manager' (b09242cd-5da3-40c7-afbc-968b127cb6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b86570-ecd3-45fd-9f76-803eeee55285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-de4fa88e-9516-4032-b59f-6157e1fe1f2f" returned: 0 in 0.644s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b86570-ecd3-45fd-9f76-803eeee55285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-629589735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af244286-3dbf-4a96-95c9-1f03ab7b14af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0c0e4e0bfd41b6b8ae9aa6bfce5426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:01Z,use_quota=True,user_id='ae41d019d8d444b0a8e587125cd92a12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91a9a80-4d7b-4801-a8d4-d8d0344c66b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91a9a80-4d7b-4801-a8d4-d8d0344c66b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd870cc-aaf6-4622-8b6f-88fd76cc96cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd870cc-aaf6-4622-8b6f-88fd76cc96cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af244286-3dbf-4a96-95c9-1f03ab7b14af', 'volume_name': 'volume-af244286-3dbf-4a96-95c9-1f03ab7b14af', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943b3fb5-403e-481b-8f71-cec241e61a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943b3fb5-403e-481b-8f71-cec241e61a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febbcc61-3cd1-4655-9ebb-9dcca5b0283d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:01 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Volume af244286-3dbf-4a96-95c9-1f03ab7b14af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af244286-3dbf-4a96-95c9-1f03ab7b14af', 'volume_size': 1}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-629589735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af244286-3dbf-4a96-95c9-1f03ab7b14af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0c0e4e0bfd41b6b8ae9aa6bfce5426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:01Z,use_quota=True,user_id='ae41d019d8d444b0a8e587125cd92a12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Creating volume af244286-3dbf-4a96-95c9-1f03ab7b14af {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:30:01 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Lock "cinder-quobyte-de4fa88e-9516-4032-b59f-6157e1fe1f2f" released by "delete_volume" :: held 1.393s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:01 devstack sudo[86154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af 1073741824
Apr 17 05:30:01 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Created reservations ['20ee9090-7413-4f4c-b5a4-4a4571f654d3', '4259ccb3-2df4-4191-94bb-323b49ba0db5', 'c5472fb1-a675-457e-bbd3-76ff1148ee6d', '35b4773a-12f7-4a72-a6a0-8ab43b3a260a'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:01 devstack sudo[86156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:01 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:01 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.455s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:01 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Deleted volume successfully.
Apr 17 05:30:01 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af 1073741824" returned: 0 in 0.561s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-817d51a5-5b65-42d1-9509-df8bd84566ee tempest-ServersNegativeTestJSON-1239533548 None] Lock "cinder-de4fa88e-9516-4032-b59f-6157e1fe1f2f-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:01 devstack sudo[86162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af
Apr 17 05:30:01 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:02 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af" returned: 0 in 0.476s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:02 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:30:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febbcc61-3cd1-4655-9ebb-9dcca5b0283d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af244286-3dbf-4a96-95c9-1f03ab7b14af', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae73e94-8578-4579-a8d4-ad7c18e1cac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:02 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Volume volume-af244286-3dbf-4a96-95c9-1f03ab7b14af (af244286-3dbf-4a96-95c9-1f03ab7b14af): created successfully
Apr 17 05:30:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae73e94-8578-4579-a8d4-ad7c18e1cac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Flow 'volume_create_manager' (b09242cd-5da3-40c7-afbc-968b127cb6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:02 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1e9d6049-6564-4dd3-8a71-8692396efb6d tempest-VolumesListAdminTestJSON-1011320039 None] Created volume successfully.
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Flow 'volume_create_manager' (5255014a-a96d-421a-9bca-5b3ab36a6ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1422f9-6223-4d65-98b1-5c3922862150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1422f9-6223-4d65-98b1-5c3922862150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1964910251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f75f0d-922d-4e12-8b9d-06adba97869b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0c0e4e0bfd41b6b8ae9aa6bfce5426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:04Z,use_quota=True,user_id='ae41d019d8d444b0a8e587125cd92a12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8482ee-e842-4ef7-be3b-526b69de45c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8482ee-e842-4ef7-be3b-526b69de45c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee09ad9-4a7c-4cc8-b839-961189ae443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee09ad9-4a7c-4cc8-b839-961189ae443e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f75f0d-922d-4e12-8b9d-06adba97869b', 'volume_name': 'volume-82f75f0d-922d-4e12-8b9d-06adba97869b', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f906a87f-8334-4e1c-b954-36883d4e50db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f906a87f-8334-4e1c-b954-36883d4e50db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddef1ce-258a-4eb4-a9b7-7128b3521381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:03 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Volume 82f75f0d-922d-4e12-8b9d-06adba97869b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f75f0d-922d-4e12-8b9d-06adba97869b', 'volume_size': 1}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1964910251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f75f0d-922d-4e12-8b9d-06adba97869b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0c0e4e0bfd41b6b8ae9aa6bfce5426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:04Z,use_quota=True,user_id='ae41d019d8d444b0a8e587125cd92a12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Creating volume 82f75f0d-922d-4e12-8b9d-06adba97869b {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:30:03 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:30:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:03 devstack sudo[86244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b 1073741824
Apr 17 05:30:03 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:04 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b 1073741824" returned: 0 in 0.731s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:04 devstack sudo[86255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b
Apr 17 05:30:04 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:05 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b" returned: 0 in 0.798s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:30:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddef1ce-258a-4eb4-a9b7-7128b3521381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f75f0d-922d-4e12-8b9d-06adba97869b', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82819b4-6fa7-48ca-a171-ec17da28ddd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:05 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Volume volume-82f75f0d-922d-4e12-8b9d-06adba97869b (82f75f0d-922d-4e12-8b9d-06adba97869b): created successfully
Apr 17 05:30:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82819b4-6fa7-48ca-a171-ec17da28ddd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Flow 'volume_create_manager' (5255014a-a96d-421a-9bca-5b3ab36a6ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:05 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-69b8117c-f7ba-49a1-a913-e63469b029b6 tempest-VolumesListAdminTestJSON-1011320039 None] Created volume successfully.
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Flow 'volume_create_manager' (40e3158e-b945-4e31-b4a1-626dbba89a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4096688-40ac-4c14-8576-549dd6ddc1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4096688-40ac-4c14-8576-549dd6ddc1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-456541420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c386e3-d2cc-4286-9944-430c7a8f0a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0c0e4e0bfd41b6b8ae9aa6bfce5426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:06Z,use_quota=True,user_id='ae41d019d8d444b0a8e587125cd92a12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f31449-dd6c-4866-97e7-1aba43c23c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f31449-dd6c-4866-97e7-1aba43c23c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57566320-0708-4339-9aec-4278b7f26221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57566320-0708-4339-9aec-4278b7f26221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c386e3-d2cc-4286-9944-430c7a8f0a5a', 'volume_name': 'volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a636804e-cc8d-4dcd-8828-754686f4ad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a636804e-cc8d-4dcd-8828-754686f4ad4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07e6072-c415-4e71-a7c2-38250f5b509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:06 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Volume 35c386e3-d2cc-4286-9944-430c7a8f0a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a', 'volume_size': 1}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-456541420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c386e3-d2cc-4286-9944-430c7a8f0a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0c0e4e0bfd41b6b8ae9aa6bfce5426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:06Z,use_quota=True,user_id='ae41d019d8d444b0a8e587125cd92a12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Creating volume 35c386e3-d2cc-4286-9944-430c7a8f0a5a {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:30:06 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:30:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:06 devstack sudo[86261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a 1073741824
Apr 17 05:30:06 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:07 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a 1073741824" returned: 0 in 0.779s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:07 devstack sudo[86273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a
Apr 17 05:30:07 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:07 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a" returned: 0 in 0.484s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:30:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07e6072-c415-4e71-a7c2-38250f5b509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30f33d2-31ad-4838-8fa9-f2c8ba60fa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:07 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Volume volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a (35c386e3-d2cc-4286-9944-430c7a8f0a5a): created successfully
Apr 17 05:30:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30f33d2-31ad-4838-8fa9-f2c8ba60fa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Flow 'volume_create_manager' (40e3158e-b945-4e31-b4a1-626dbba89a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:07 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c19c23f0-b4fe-4a81-b83f-9746a87e51d5 tempest-VolumesListAdminTestJSON-1011320039 None] Created volume successfully.
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Flow 'volume_create_manager' (d704f4e3-d464-4b55-93a5-61d59906f020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11edc4d-acc3-472d-b545-0f708b4d229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11edc4d-acc3-472d-b545-0f708b4d229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36908eb69bb40b49e060bad5f0a6690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:09Z,use_quota=True,user_id='c8baf1ab337f46aeb9abbdcd0534a49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024dec5e-cfc9-4404-98d3-1fcb723d06c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024dec5e-cfc9-4404-98d3-1fcb723d06c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3735bf18-0507-42ac-bae4-feb6794c3e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3735bf18-0507-42ac-bae4-feb6794c3e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e2bcd5-5ab9-498c-8b70-1cf59d8797f2', 'volume_name': 'volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2eb736-7d5c-4bb6-8fa4-1f48fca30eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2eb736-7d5c-4bb6-8fa4-1f48fca30eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82cec6e1-1cf4-4adc-aa8e-f2140bdc0046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:09 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Volume d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2', 'volume_size': 1}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36908eb69bb40b49e060bad5f0a6690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:09Z,use_quota=True,user_id='c8baf1ab337f46aeb9abbdcd0534a49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Creating volume d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:30:09 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:09 devstack sudo[86288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2 1073741824
Apr 17 05:30:09 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:09 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2 1073741824" returned: 0 in 0.645s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:09 devstack sudo[86296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2
Apr 17 05:30:09 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:10 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2" returned: 0 in 0.498s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:30:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82cec6e1-1cf4-4adc-aa8e-f2140bdc0046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fafbe6c-5b18-4081-bbe8-c20514bb0f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:10 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Volume volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2 (d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2): created successfully
Apr 17 05:30:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fafbe6c-5b18-4081-bbe8-c20514bb0f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Flow 'volume_create_manager' (d704f4e3-d464-4b55-93a5-61d59906f020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:10 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9ea350ab-63c3-417d-976a-78d766412f82 tempest-VolumesListAdminTestJSON-885753303 None] Created volume successfully.
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Acquiring lock "cinder-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Lock "cinder-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Acquiring lock "cinder-quobyte-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Lock "cinder-quobyte-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2" acquired by "delete_volume" :: waited 0.019s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8053a5e-a8d0-4777-ab13-d731d46a68ac]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "cinder-35c386e3-d2cc-4286-9944-430c7a8f0a5a-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-35c386e3-d2cc-4286-9944-430c7a8f0a5a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "cinder-quobyte-35c386e3-d2cc-4286-9944-430c7a8f0a5a" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-quobyte-35c386e3-d2cc-4286-9944-430c7a8f0a5a" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ce7e73-eb9e-4d49-991f-2167c43cf93b]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:11 devstack sudo[86364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2
Apr 17 05:30:11 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:11 devstack sudo[86366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a
Apr 17 05:30:11 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:12 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2" returned: 0 in 1.396s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:12 devstack sudo[86389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2
Apr 17 05:30:12 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:13 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a" returned: 0 in 1.544s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:13 devstack sudo[86412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a
Apr 17 05:30:13 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:13 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2" returned: 0 in 0.816s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Lock "cinder-quobyte-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2" released by "delete_volume" :: held 2.285s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Created reservations ['6477a178-2ad6-417b-8ee7-ebbddfb224ab', 'f42b8335-204a-4e38-a181-8d68abf68fad', '6b19fa67-5572-468a-bb55-f34f963e4124', '50d19527-f953-47ef-82e2-a8c298cbb1d4'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:13 devstack sudo[86425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:13 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:14 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-35c386e3-d2cc-4286-9944-430c7a8f0a5a" returned: 0 in 0.895s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-quobyte-35c386e3-d2cc-4286-9944-430c7a8f0a5a" released by "delete_volume" :: held 2.510s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Created reservations ['c07ff793-9056-4a93-afb8-bddea7769d08', '7ab04bbb-a69f-48b8-80b6-25f47ecabd85', '7298ac8c-b51b-4e62-8d77-f70e836354a5', 'a8b47c6a-07ce-4b1d-a724-7727be126f70'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:14 devstack sudo[86429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:14 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:14 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.582s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Deleted volume successfully.
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8a073b8d-7990-4fb6-af8d-dd10bb73b09c tempest-VolumesListAdminTestJSON-885753303 None] Lock "cinder-d7e2bcd5-5ab9-498c-8b70-1cf59d8797f2-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ae247790-6e7e-4731-9d4e-b8ce4d29a083 tempest-VolumesActionsTest-730828754 None] Acquiring lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369" by "attach_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ae247790-6e7e-4731-9d4e-b8ce4d29a083 tempest-VolumesActionsTest-730828754 None] Lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369" acquired by "attach_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:14 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ae247790-6e7e-4731-9d4e-b8ce4d29a083 tempest-VolumesActionsTest-730828754 None] Attaching volume a0de8fd6-07be-4c3b-985a-bd94e1233369 to instance 160b5715-18d4-4074-a008-3fcec0cea7e5 at mountpoint /dev/vdb on host None.
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.648s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Deleted volume successfully.
Apr 17 05:30:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ae247790-6e7e-4731-9d4e-b8ce4d29a083 tempest-VolumesActionsTest-730828754 None] Attach volume completed successfully.
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fbea41c6-2e9f-4878-963d-f14507101bd4 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-35c386e3-d2cc-4286-9944-430c7a8f0a5a-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ae247790-6e7e-4731-9d4e-b8ce4d29a083 tempest-VolumesActionsTest-730828754 None] Lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369" released by "attach_volume" :: held 0.108s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "cinder-82f75f0d-922d-4e12-8b9d-06adba97869b-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-82f75f0d-922d-4e12-8b9d-06adba97869b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "cinder-quobyte-82f75f0d-922d-4e12-8b9d-06adba97869b" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-quobyte-82f75f0d-922d-4e12-8b9d-06adba97869b" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56f74ba-0ed6-4191-8af8-65cd96cc4e50]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:15 devstack sudo[86433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b
Apr 17 05:30:15 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-711379bf-7e7a-443a-a403-3832b9e1c5de tempest-VolumesActionsTest-730828754 None] Acquiring lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369-detach_volume" by "detach_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-711379bf-7e7a-443a-a403-3832b9e1c5de tempest-VolumesActionsTest-730828754 None] Lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-711379bf-7e7a-443a-a403-3832b9e1c5de tempest-VolumesActionsTest-730828754 None] Detaching volume a0de8fd6-07be-4c3b-985a-bd94e1233369 from instance 160b5715-18d4-4074-a008-3fcec0cea7e5.
Apr 17 05:30:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-711379bf-7e7a-443a-a403-3832b9e1c5de tempest-VolumesActionsTest-730828754 None] Detach volume completed successfully.
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-711379bf-7e7a-443a-a403-3832b9e1c5de tempest-VolumesActionsTest-730828754 None] Lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:15 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b" returned: 0 in 0.603s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:15 devstack sudo[86438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b
Apr 17 05:30:15 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:16 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-82f75f0d-922d-4e12-8b9d-06adba97869b" returned: 0 in 0.544s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-quobyte-82f75f0d-922d-4e12-8b9d-06adba97869b" released by "delete_volume" :: held 1.210s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Created reservations ['d2ce46b7-fb20-4cef-992c-7b8350a5f960', 'ad8ca849-4795-4048-8b42-9089cc8dcbfa', '9434628a-1510-4985-806b-ff7fd13b96d7', '800291fc-52a3-4aac-a994-6093c800c875'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:16 devstack sudo[86443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:16 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:16 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.440s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:16 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Deleted volume successfully.
Apr 17 05:30:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92d02040-93a0-43c7-b2fd-3a288d8e5332 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-82f75f0d-922d-4e12-8b9d-06adba97869b-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e00bd113-94a8-4b35-84c8-a52eb3f455c8 tempest-BackendsCapabilitiesAdminTestsJSON-12296473 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82266) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 17 05:30:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "cinder-af244286-3dbf-4a96-95c9-1f03ab7b14af-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-af244286-3dbf-4a96-95c9-1f03ab7b14af-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "cinder-quobyte-af244286-3dbf-4a96-95c9-1f03ab7b14af" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-quobyte-af244286-3dbf-4a96-95c9-1f03ab7b14af" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:17 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ec7829-e4fc-43de-83e0-5fe4565816c3]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:17 devstack sudo[86480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af
Apr 17 05:30:17 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-18b66dde-93e9-4135-a9bc-8325e99ad098 tempest-BackendsCapabilitiesAdminTestsJSON-12296473 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82266) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 17 05:30:18 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af" returned: 0 in 0.764s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:18 devstack sudo[86523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af
Apr 17 05:30:18 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:18 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-af244286-3dbf-4a96-95c9-1f03ab7b14af" returned: 0 in 0.571s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-quobyte-af244286-3dbf-4a96-95c9-1f03ab7b14af" released by "delete_volume" :: held 1.406s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Created reservations ['e07d1703-1abf-498a-b0ee-8e932ed2aa1b', 'ca19c753-9141-422f-9f23-673a4a84b0be', '7be7251c-3783-43dd-9cf0-bafb7b6028bd', 'bd4e3ab8-350b-4373-adf0-17b035138079'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:18 devstack sudo[86528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:18 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:19 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.610s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:19 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:19 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Deleted volume successfully.
Apr 17 05:30:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33e46123-db9a-4b1c-b52a-57a8d718e334 tempest-VolumesListAdminTestJSON-1011320039 None] Lock "cinder-af244286-3dbf-4a96-95c9-1f03ab7b14af-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Flow 'volume_create_manager' (06ea294c-912e-45fb-bf86-4f566d90b1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21474f25-2a1b-47e3-858a-8da9b4d81cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21474f25-2a1b-47e3-858a-8da9b4d81cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-460402773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ce5fef-5cac-4358-a830-54b23e81cfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b361ccb84a64ac88d7fb0ae585b477e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:24Z,use_quota=True,user_id='923c6dec489d4f1f98075edda5cf850b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a541169-2945-42da-8698-be775e3bd366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a541169-2945-42da-8698-be775e3bd366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fabb9f-84a8-456c-b8aa-5103f9a120d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fabb9f-84a8-456c-b8aa-5103f9a120d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ce5fef-5cac-4358-a830-54b23e81cfb6', 'volume_name': 'volume-04ce5fef-5cac-4358-a830-54b23e81cfb6', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce38714-93da-4b4b-aa24-7a92cd191bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce38714-93da-4b4b-aa24-7a92cd191bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafb26ab-b598-40b8-9294-870c4bd8b479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:24 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Volume 04ce5fef-5cac-4358-a830-54b23e81cfb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ce5fef-5cac-4358-a830-54b23e81cfb6', 'volume_size': 1}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-460402773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ce5fef-5cac-4358-a830-54b23e81cfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b361ccb84a64ac88d7fb0ae585b477e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:24Z,use_quota=True,user_id='923c6dec489d4f1f98075edda5cf850b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Creating volume 04ce5fef-5cac-4358-a830-54b23e81cfb6 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:30:24 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:30:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:24 devstack sudo[86587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6 1073741824
Apr 17 05:30:24 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:25 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6 1073741824" returned: 0 in 0.824s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:25 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6
Apr 17 05:30:25 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:25 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6" returned: 0 in 0.684s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:30:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafb26ab-b598-40b8-9294-870c4bd8b479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ce5fef-5cac-4358-a830-54b23e81cfb6', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2670ac02-2841-4f5c-b1b7-575bab65402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:25 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Volume volume-04ce5fef-5cac-4358-a830-54b23e81cfb6 (04ce5fef-5cac-4358-a830-54b23e81cfb6): created successfully
Apr 17 05:30:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2670ac02-2841-4f5c-b1b7-575bab65402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Flow 'volume_create_manager' (06ea294c-912e-45fb-bf86-4f566d90b1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:26 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-60ed9474-4713-4eef-b263-c2a0aa0b21a7 tempest-AbsoluteLimitsTests-1839942207 None] Created volume successfully.
Apr 17 05:30:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Acquiring lock "cinder-04ce5fef-5cac-4358-a830-54b23e81cfb6-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Lock "cinder-04ce5fef-5cac-4358-a830-54b23e81cfb6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Acquiring lock "cinder-quobyte-04ce5fef-5cac-4358-a830-54b23e81cfb6" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Lock "cinder-quobyte-04ce5fef-5cac-4358-a830-54b23e81cfb6" acquired by "delete_volume" :: waited 0.017s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:26 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f9eb33-0c4b-4895-b493-f6aa1e211acf]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:26 devstack sudo[86596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6
Apr 17 05:30:26 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:27 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-44ef1f84-20fd-49fe-884a-6f8a027c0798 tempest-GroupsV314Test-1197723161 None] Group tempest-GroupsV314Test-Group-1898346801: creating
Apr 17 05:30:27 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-44ef1f84-20fd-49fe-884a-6f8a027c0798 tempest-GroupsV314Test-1197723161 None] Group tempest-GroupsV314Test-Group-1898346801: created successfully
Apr 17 05:30:27 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-44ef1f84-20fd-49fe-884a-6f8a027c0798 tempest-GroupsV314Test-1197723161 None] Create group completed successfully.
Apr 17 05:30:27 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6" returned: 0 in 0.782s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:27 devstack sudo[86624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6
Apr 17 05:30:27 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:27 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-04ce5fef-5cac-4358-a830-54b23e81cfb6" returned: 0 in 0.432s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Lock "cinder-quobyte-04ce5fef-5cac-4358-a830-54b23e81cfb6" released by "delete_volume" :: held 1.242s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Created reservations ['57ac3407-05d5-44b0-ad04-106e3aff6333', '6b8fb06c-233e-4155-8499-ef5cb47bed6c', '6db569d5-6a99-42b9-a26d-eab046986d58', '6b71737c-ad7d-4caa-a8e4-7c8c894ad90f'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:27 devstack sudo[86628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:27 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:28 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.549s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:28 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Deleted volume successfully.
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dbe8e914-b278-4cc1-8e42-99af13366270 tempest-AbsoluteLimitsTests-1839942207 None] Lock "cinder-04ce5fef-5cac-4358-a830-54b23e81cfb6-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Flow 'volume_create_manager' (9dda362e-c51d-4a43-ba3b-4aabbe52a621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679a9a06-c482-4401-aa98-76caa973b017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679a9a06-c482-4401-aa98-76caa973b017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1385617641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=816ad3a0-9a1e-4339-8fe2-fd76a5902c2e,host='devstack@QuobyteHD#QuobyteHD',id=2fa0991c-0522-436f-a8b9-4217b9739e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c96c165120c45cfa534d99aafc42f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:29Z,use_quota=True,user_id='7f19f3934aaa49faa0a6a71abbacddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7724c25-1898-4e62-af8e-09c17ce98c78),volume_type_id=e7724c25-1898-4e62-af8e-09c17ce98c78)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd89113b-a824-4694-84df-162c05a7cb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd89113b-a824-4694-84df-162c05a7cb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17cdc54-6978-4347-bc9e-09b836c6c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17cdc54-6978-4347-bc9e-09b836c6c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa0991c-0522-436f-a8b9-4217b9739e78', 'volume_name': 'volume-2fa0991c-0522-436f-a8b9-4217b9739e78', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c497aceb-b707-4ae7-9ed5-9cdfe335698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c497aceb-b707-4ae7-9ed5-9cdfe335698c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310dea81-f6cd-4dda-97a4-877d14c15168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:28 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Volume 2fa0991c-0522-436f-a8b9-4217b9739e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa0991c-0522-436f-a8b9-4217b9739e78', 'volume_size': 1}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=816ad3a0-9a1e-4339-8fe2-fd76a5902c2e,created_at=2026-04-17T03:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1385617641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=816ad3a0-9a1e-4339-8fe2-fd76a5902c2e,host='devstack@QuobyteHD#QuobyteHD',id=2fa0991c-0522-436f-a8b9-4217b9739e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c96c165120c45cfa534d99aafc42f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:29Z,use_quota=True,user_id='7f19f3934aaa49faa0a6a71abbacddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7724c25-1898-4e62-af8e-09c17ce98c78),volume_type_id=e7724c25-1898-4e62-af8e-09c17ce98c78)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Creating volume 2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:30:28 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:30:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:28 devstack sudo[86633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 1073741824
Apr 17 05:30:28 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:29 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-d09ffa34-57f9-46eb-bc79-cf7af8bd5f2c tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Terminate volume connection completed successfully.
Apr 17 05:30:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-d09ffa34-57f9-46eb-bc79-cf7af8bd5f2c tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Deleting attachment 1649f7db-a2de-4594-8cdd-e100743ef037. {{(pid=82266) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 17 05:30:29 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 1073741824" returned: 0 in 0.631s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:29 devstack sudo[86639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78
Apr 17 05:30:29 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "cinder-20a10a34-6791-4c12-a586-dd66b9957094-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "cinder-20a10a34-6791-4c12-a586-dd66b9957094-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "cinder-quobyte-20a10a34-6791-4c12-a586-dd66b9957094" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "cinder-quobyte-20a10a34-6791-4c12-a586-dd66b9957094" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:29 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f509769-fe4b-4dde-9eca-274ca93edea3]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:30 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78" returned: 0 in 0.585s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:30:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310dea81-f6cd-4dda-97a4-877d14c15168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa0991c-0522-436f-a8b9-4217b9739e78', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fb8bda-2a2d-40d1-afd9-a1c8416864e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:30 devstack sudo[86643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094
Apr 17 05:30:30 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:30 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Volume volume-2fa0991c-0522-436f-a8b9-4217b9739e78 (2fa0991c-0522-436f-a8b9-4217b9739e78): created successfully
Apr 17 05:30:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fb8bda-2a2d-40d1-afd9-a1c8416864e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Flow 'volume_create_manager' (9dda362e-c51d-4a43-ba3b-4aabbe52a621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:30 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4074d3d1-a8d2-46c7-b9aa-a60fdab87878 tempest-GroupsV314Test-1197723161 None] Created volume successfully.
Apr 17 05:30:30 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094" returned: 0 in 0.623s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:30 devstack sudo[86662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094
Apr 17 05:30:30 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:31 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094" returned: 1 in 0.596s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:31 devstack sudo[86667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094
Apr 17 05:30:31 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Flow 'volume_create_manager' (97dce828-ee55-4030-a4fd-065b32eeed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f77b8b-c433-4035-b5b4-73df560eb6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f77b8b-c433-4035-b5b4-73df560eb6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-255275778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa52917a-a5fb-45e8-b101-d22bdb578227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9373efc7f2094cb08eebad10c8ee68f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:32Z,use_quota=True,user_id='7a5813c67c1545ad88005d44c1ff2c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:31 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ec3923-c52f-46aa-bcf2-ce3f4a74eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ec3923-c52f-46aa-bcf2-ce3f4a74eb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b635cf-8b47-40a3-9ab6-62ce2663683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b635cf-8b47-40a3-9ab6-62ce2663683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa52917a-a5fb-45e8-b101-d22bdb578227', 'volume_name': 'volume-fa52917a-a5fb-45e8-b101-d22bdb578227', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dba1bc-8864-47fb-ac84-b099845be398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dba1bc-8864-47fb-ac84-b099845be398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d4c4c9-083b-4779-82d5-787678943c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Volume fa52917a-a5fb-45e8-b101-d22bdb578227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa52917a-a5fb-45e8-b101-d22bdb578227', 'volume_size': 1}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-255275778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa52917a-a5fb-45e8-b101-d22bdb578227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9373efc7f2094cb08eebad10c8ee68f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:32Z,use_quota=True,user_id='7a5813c67c1545ad88005d44c1ff2c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Creating volume fa52917a-a5fb-45e8-b101-d22bdb578227 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:30:31 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:31 devstack sudo[86670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227 1073741824
Apr 17 05:30:31 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-20a10a34-6791-4c12-a586-dd66b9957094" returned: 0 in 0.594s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "cinder-quobyte-20a10a34-6791-4c12-a586-dd66b9957094" released by "delete_volume" :: held 1.862s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.quota [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Created reservations ['755941a3-c956-4481-8b4a-11f76fbda2f0', '9c9bfb27-5314-40fe-bb91-d4859102f1c0', '6157ad61-2ac3-4dba-bae7-848641e01bdd', 'c8929c4d-352d-4a56-9fbc-b8b2291de3f7'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:31 devstack sudo[86672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:31 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:32 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:32 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.521s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG cinder.manager [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227 1073741824" returned: 0 in 0.649s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:32 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Deleted volume successfully.
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-571d8c26-dfe0-4382-be0a-eef0c72be0b8 req-7acbe6f2-66fe-40fb-b871-d71b4e2253b6 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "cinder-20a10a34-6791-4c12-a586-dd66b9957094-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:32 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227
Apr 17 05:30:32 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:32 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227" returned: 0 in 0.452s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.068s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:32 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Cloning volume 2fa0991c-0522-436f-a8b9-4217b9739e78 to volume 2334610e-b2f3-48d8-883b-050b7bbbfe6e
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d4c4c9-083b-4779-82d5-787678943c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa52917a-a5fb-45e8-b101-d22bdb578227', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e155fd-b965-4e27-b783-7e0529fdce17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:32 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Volume volume-fa52917a-a5fb-45e8-b101-d22bdb578227 (fa52917a-a5fb-45e8-b101-d22bdb578227): created successfully
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e155fd-b965-4e27-b783-7e0529fdce17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Flow 'volume_create_manager' (97dce828-ee55-4030-a4fd-065b32eeed80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Creating offline snapshot 7bcb9ef0-08a1-484d-a877-3e8d65185f0d of volume 2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:30:32 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-bfc7b4fd-f1d8-463a-bc9e-8f7730128240 tempest-VolumesDeleteCascade-199668281 None] Created volume successfully.
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd36d5b3-c952-47fb-92bb-fcf4347cfb91]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:33 devstack sudo[86684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78
Apr 17 05:30:33 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:33 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78" returned: 0 in 0.545s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:33 devstack sudo[86690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d 1G
Apr 17 05:30:33 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:34 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d 1G" returned: 0 in 0.739s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa0991c-0522-436f-a8b9-4217b9739e78 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:34 devstack sudo[86721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa0991c-0522-436f-a8b9-4217b9739e78 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d
Apr 17 05:30:34 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:34 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa0991c-0522-436f-a8b9-4217b9739e78 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d" returned: 0 in 0.651s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:34 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:30:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:34 devstack sudo[86750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d
Apr 17 05:30:34 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:35 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d" returned: 0 in 0.551s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:35 devstack sudo[86754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.info
Apr 17 05:30:35 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:35 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.info" returned: 0 in 0.413s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:35 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:30:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:35 devstack sudo[86758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.info
Apr 17 05:30:35 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f8993f91-a7e4-419e-87a8-d2e30adb0ee7 tempest-VolumesActionsTest-730828754 None] Acquiring lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369" by "attach_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f8993f91-a7e4-419e-87a8-d2e30adb0ee7 tempest-VolumesActionsTest-730828754 None] Lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369" acquired by "attach_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f8993f91-a7e4-419e-87a8-d2e30adb0ee7 tempest-VolumesActionsTest-730828754 None] Attaching volume a0de8fd6-07be-4c3b-985a-bd94e1233369 to instance e0b6214f-7638-4e99-99f7-a6c353f2b6a7 at mountpoint /dev/vdb on host None.
Apr 17 05:30:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f8993f91-a7e4-419e-87a8-d2e30adb0ee7 tempest-VolumesActionsTest-730828754 None] Attach volume completed successfully.
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f8993f91-a7e4-419e-87a8-d2e30adb0ee7 tempest-VolumesActionsTest-730828754 None] Lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369" released by "attach_volume" :: held 0.059s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:36 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.info" returned: 0 in 0.554s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Acquiring lock "cinder-quobyte-2334610e-b2f3-48d8-883b-050b7bbbfe6e" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Lock "cinder-quobyte-2334610e-b2f3-48d8-883b-050b7bbbfe6e" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] snapshot: 7bcb9ef0-08a1-484d-a877-3e8d65185f0d, volume: 2334610e-b2f3-48d8-883b-050b7bbbfe6e,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff054ad-c120-4669-9af3-981b0e5f2614]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:36 devstack sudo[86762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d
Apr 17 05:30:36 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2f2ac879-4b38-4f66-8401-017ed8be74e0 tempest-VolumesActionsTest-730828754 None] Acquiring lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369-detach_volume" by "detach_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2f2ac879-4b38-4f66-8401-017ed8be74e0 tempest-VolumesActionsTest-730828754 None] Lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-2f2ac879-4b38-4f66-8401-017ed8be74e0 tempest-VolumesActionsTest-730828754 None] Detaching volume a0de8fd6-07be-4c3b-985a-bd94e1233369 from instance e0b6214f-7638-4e99-99f7-a6c353f2b6a7.
Apr 17 05:30:37 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-2f2ac879-4b38-4f66-8401-017ed8be74e0 tempest-VolumesActionsTest-730828754 None] Detach volume completed successfully.
Apr 17 05:30:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2f2ac879-4b38-4f66-8401-017ed8be74e0 tempest-VolumesActionsTest-730828754 None] Lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:37 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d" returned: 0 in 0.548s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fa0991c-0522-436f-a8b9-4217b9739e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:30:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:30:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:30:37 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b802b24-8442-48ef-90a1-3dba9631c562]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:37 devstack sudo[86768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78
Apr 17 05:30:37 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:37 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78" returned: 0 in 0.566s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:37 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:30:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:37 devstack sudo[86773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e
Apr 17 05:30:37 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:40 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e" returned: 0 in 2.690s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:40 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c549ecc-7a75-448b-b095-1e46af480062]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:40 devstack sudo[86815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78
Apr 17 05:30:40 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:40 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78" returned: 0 in 0.639s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:40 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78, size 1024.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:30:40 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Converted 1024.00 MB image at 380.42 MB/s
Apr 17 05:30:40 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e is being set with open permissions: ugo+rw: NotImplementedError
Apr 17 05:30:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:40 devstack sudo[86821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e
Apr 17 05:30:40 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:41 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e" returned: 0 in 0.531s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Lock "cinder-quobyte-2334610e-b2f3-48d8-883b-050b7bbbfe6e" released by "_copy_volume_from_snapshot" :: held 5.040s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Acquiring lock "cinder-quobyte-7bcb9ef0-08a1-484d-a877-3e8d65185f0d" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Lock "cinder-quobyte-7bcb9ef0-08a1-484d-a877-3e8d65185f0d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Deleting offline snapshot 7bcb9ef0-08a1-484d-a877-3e8d65185f0d of volume 2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:30:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] snapshot_file for this snap is: volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:30:41 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d0ce79-1c72-4026-b1a9-4741bcd3200d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:41 devstack sudo[86845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d
Apr 17 05:30:41 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:42 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d" returned: 0 in 0.546s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fa0991c-0522-436f-a8b9-4217b9739e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:30:42 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2bc90b-6e1c-4ba4-8bcc-b692ce43e538]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:42 devstack sudo[86851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78
Apr 17 05:30:42 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:42 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78" returned: 0 in 0.519s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:42 devstack sudo[86857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d
Apr 17 05:30:42 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:43 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d" returned: 0 in 0.476s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:43 devstack sudo[86863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d
Apr 17 05:30:43 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:43 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78.7bcb9ef0-08a1-484d-a877-3e8d65185f0d" returned: 0 in 0.426s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Lock "cinder-quobyte-7bcb9ef0-08a1-484d-a877-3e8d65185f0d" released by "_delete_snapshot" :: held 2.017s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.645s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.607s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Creating offline snapshot df08a7a6-181c-4f82-87ac-00811cd96c96 of volume fa52917a-a5fb-45e8-b101-d22bdb578227 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:30:43 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[107590a4-dea2-4e6e-864b-f0590eebcc5e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:43 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1a320980-1daa-40e5-af99-8cda69187eaf tempest-GroupsV314Test-1197723161 None] Create group from source-group-816ad3a0-9a1e-4339-8fe2-fd76a5902c2e completed successfully.
Apr 17 05:30:43 devstack sudo[86866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227
Apr 17 05:30:43 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:43 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-c55adf03-326c-465a-a562-9f88179e2aff tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Terminate volume connection completed successfully.
Apr 17 05:30:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-c55adf03-326c-465a-a562-9f88179e2aff tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Deleting attachment c1f5f4fb-e5a9-4fa3-a48e-29df58520645. {{(pid=82266) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 17 05:30:44 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227" returned: 0 in 0.489s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:44 devstack sudo[86871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 1G
Apr 17 05:30:44 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Acquiring lock "cinder-quobyte-2334610e-b2f3-48d8-883b-050b7bbbfe6e" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Lock "cinder-quobyte-2334610e-b2f3-48d8-883b-050b7bbbfe6e" acquired by "delete_volume" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "cinder-8aeb05c0-b07a-408f-9e83-2192be9e99a0-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce6c796-428d-4306-8ea2-3087a5be6a53]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "cinder-8aeb05c0-b07a-408f-9e83-2192be9e99a0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "cinder-quobyte-8aeb05c0-b07a-408f-9e83-2192be9e99a0" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "cinder-quobyte-8aeb05c0-b07a-408f-9e83-2192be9e99a0" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ffc481-6f86-46bd-b249-d00a1f754a4b]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:44 devstack sudo[86873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e
Apr 17 05:30:44 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:44 devstack sudo[86874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0
Apr 17 05:30:44 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:44 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 1G" returned: 0 in 0.560s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa52917a-a5fb-45e8-b101-d22bdb578227 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:44 devstack sudo[86880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa52917a-a5fb-45e8-b101-d22bdb578227 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96
Apr 17 05:30:44 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:44 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e" returned: 0 in 0.644s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:44 devstack sudo[86888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e
Apr 17 05:30:44 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:45 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0" returned: 0 in 0.680s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:45 devstack sudo[86893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0
Apr 17 05:30:45 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:45 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa52917a-a5fb-45e8-b101-d22bdb578227 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96" returned: 0 in 0.525s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:45 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 is being set with open permissions: ugo+rw
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:45 devstack sudo[86895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96
Apr 17 05:30:45 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:45 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2334610e-b2f3-48d8-883b-050b7bbbfe6e" returned: 0 in 0.468s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Lock "cinder-quobyte-2334610e-b2f3-48d8-883b-050b7bbbfe6e" released by "delete_volume" :: held 1.150s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Created reservations ['e2b64730-0577-4c98-8a23-d7234d3bc423'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:45 devstack cinder-volume[82266]: WARNING cinder.quota [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1945071763 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1945071763, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:30:45 devstack cinder-volume[82266]: WARNING cinder.quota [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1945071763 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1945071763, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Created reservations ['949ac0e1-6623-42d4-a74e-f5b70a160253', '5a27cb50-18c8-46e7-ad7a-682665a1616d', 'be0622a2-59da-474c-b7b5-a39261db08fb', 'dfdbf502-7f02-427d-9eb5-2e488adef47d'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:45 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8aeb05c0-b07a-408f-9e83-2192be9e99a0" returned: 0 in 0.489s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "cinder-quobyte-8aeb05c0-b07a-408f-9e83-2192be9e99a0" released by "delete_volume" :: held 1.194s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:45 devstack sudo[86901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:45 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG cinder.quota [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Created reservations ['28c86af8-0654-4e33-9460-f3aa27cf2869', 'b6422feb-e000-4672-a084-3219661da918', 'c1b3d1d0-8124-4e8c-9705-cc072f733405', '391b656e-9d27-4db0-9b3e-3d690ea0b72e'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:45 devstack sudo[86904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:45 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:45 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96" returned: 0 in 0.519s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:45 devstack sudo[86906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.info
Apr 17 05:30:45 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:45 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.424s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:46 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-209db597-644e-4e27-adaf-928279fd83bd tempest-GroupsV314Test-1197723161 None] Delete group completed successfully.
Apr 17 05:30:46 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.434s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG cinder.manager [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:46 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Deleted volume successfully.
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-31fc79c6-6a3a-4c5e-af83-9c6209ed6ae6 req-2cd6fb88-c1bd-4eb0-b6b6-d6e619827ab1 tempest-ServerBootFromVolumeStableRescueTest-1035907712 None] Lock "cinder-8aeb05c0-b07a-408f-9e83-2192be9e99a0-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:46 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.info" returned: 0 in 0.447s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:46 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.info is being set with open permissions: ugo+rw
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:46 devstack sudo[86911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.info
Apr 17 05:30:46 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:46 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.info" returned: 0 in 0.466s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.077s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.350s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50eeb08-1e03-4e93-ba70-0923140856cd]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Acquiring lock "cinder-quobyte-2fa0991c-0522-436f-a8b9-4217b9739e78" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:30:46 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e22247f8-f60c-43e2-9950-ecf9ac94c486 tempest-VolumesDeleteCascade-199668281 None] Create snapshot completed successfully
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Lock "cinder-quobyte-2fa0991c-0522-436f-a8b9-4217b9739e78" acquired by "delete_volume" :: waited 0.017s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b435d2-bdcf-4ebd-a3cc-489a83b01420]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:46 devstack sudo[86920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369
Apr 17 05:30:46 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:46 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78
Apr 17 05:30:46 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:47 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369" returned: 0 in 0.481s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[460fa0c0-b5bf-42a0-b328-33ea99a9f89b]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:47 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78" returned: 0 in 0.492s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:47 devstack sudo[86932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78
Apr 17 05:30:47 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:47 devstack sudo[86931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369
Apr 17 05:30:47 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:47 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2fa0991c-0522-436f-a8b9-4217b9739e78" returned: 0 in 0.512s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Lock "cinder-quobyte-2fa0991c-0522-436f-a8b9-4217b9739e78" released by "delete_volume" :: held 1.031s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:30:47 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369" returned: 0 in 0.586s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.f5ee0801-30ef-480f-8999-b602a386c6b2vap1n6ym.img {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:47 devstack sudo[86940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.f5ee0801-30ef-480f-8999-b602a386c6b2vap1n6ym.img
Apr 17 05:30:47 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Created reservations ['d71cf513-56ac-425e-83d0-0a7296d89523'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Created reservations ['6f1087b5-615a-4498-8262-819229e402b4', '723581e1-d9e4-45cf-8666-6402528feca4', 'ba4174ba-066c-48d5-8c58-18e9add9b4cc', '905c1a35-18a3-495f-88ee-33508048ef07'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:47 devstack sudo[86942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:47 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:48 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.614s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:48 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:48 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-841d9d78-1dec-4b66-9396-7aff83948757 tempest-GroupsV314Test-1197723161 None] Delete group completed successfully.
Apr 17 05:30:50 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.f5ee0801-30ef-480f-8999-b602a386c6b2vap1n6ym.img" returned: 0 in 2.414s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:50 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d561c7b0-0ed8-4a78-846d-0a7250eda7b1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:30:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:50 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369
Apr 17 05:30:50 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:50 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369" returned: 0 in 0.721s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:50 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.f5ee0801-30ef-480f-8999-b602a386c6b2vap1n6ym.img {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:30:50 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Converted 1024.00 MB image at 423.95 MB/s
Apr 17 05:30:50 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] f5ee0801-30ef-480f-8999-b602a386c6b2 was raw, no need to convert to raw {{(pid=82266) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 17 05:30:52 devstack cinder-volume[82266]: DEBUG oslo_service.periodic_task [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:30:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:30:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:30:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:30:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:30:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:30:52 devstack sudo[86994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:30:52 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:30:53 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root
Apr 17 05:30:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.524s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:30:53 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Flow 'volume_create_manager' (e57aedc7-bbb3-463a-bb41-c58c8d8079dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88014b5c-4f1a-421a-815c-a3b844a7b81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88014b5c-4f1a-421a-815c-a3b844a7b81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-902144722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e785b8e1-a87b-4d50-a9ab-4bac2356e8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c74bc3886d4950b75b8318d357657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:57Z,use_quota=True,user_id='eab47e3051d943ed9b7a1c222c4eb85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1cca5b-597a-485c-afd9-af8dc1d2a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1cca5b-597a-485c-afd9-af8dc1d2a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a2266e-8769-4bed-8a23-c359a3b0fcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a2266e-8769-4bed-8a23-c359a3b0fcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e785b8e1-a87b-4d50-a9ab-4bac2356e8a2', 'volume_name': 'volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c95160-5be9-44ea-8a26-eee4219d6c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c95160-5be9-44ea-8a26-eee4219d6c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd98d68e-8b7f-4817-807c-bcaaaebdbee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:57 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Volume e785b8e1-a87b-4d50-a9ab-4bac2356e8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2', 'volume_size': 1}
Apr 17 05:30:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:UPDATE=143,cinder:SELECT=119,cinder:INSERT=35,cinder:DELETE=11 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:UPDATE=120,cinder:SELECT=100,cinder:INSERT=26,cinder:DELETE=7 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Flow 'volume_create_manager' (de3cd58d-9590-44ab-ba38-9cd1ca94966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fda977-1d42-4013-bf0b-1feff6e5c0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fda977-1d42-4013-bf0b-1feff6e5c0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-47071494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd04d5e18fdb4e65bf2c7bff04a0b9dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:00Z,use_quota=True,user_id='27c96521013a4317b1d00cbe844a1bc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bada00e-35f0-42fb-8557-355e1d4402c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bada00e-35f0-42fb-8557-355e1d4402c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575e6d6a-7854-427f-b623-48c3aeb9579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575e6d6a-7854-427f-b623-48c3aeb9579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f', 'volume_name': 'volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a783f0b0-1f91-49eb-8852-dc0dde71f6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a783f0b0-1f91-49eb-8852-dc0dde71f6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17cc9cea-d037-4a42-9436-887629d6ce2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:30:59 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Volume 9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f', 'volume_size': 1}
Apr 17 05:30:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.429s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Uploaded volume to glance image-id: f5ee0801-30ef-480f-8999-b602a386c6b2. {{(pid=82266) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 17 05:31:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.455s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:02 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] Creating offline snapshot 3e403449-bc7d-4199-825c-c30fdbf6bbce of volume fa52917a-a5fb-45e8-b101-d22bdb578227 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:31:02 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ef65ce55-9d7c-49a6-b1e2-6837a2b61621 tempest-VolumesActionsTest-730828754 None] Copy volume to image completed successfully.
Apr 17 05:31:02 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb8bd2a-13de-4e92-94f6-630e58aa9edd]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:02 devstack sudo[87000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96
Apr 17 05:31:02 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:02 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:02 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa52917a-a5fb-45e8-b101-d22bdb578227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:31:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:02 devstack sudo[87005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce 1G
Apr 17 05:31:02 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:03 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce 1G" returned: 0 in 0.599s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:03 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce
Apr 17 05:31:03 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:03 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce" returned: 0 in 0.446s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:03 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce is being set with open permissions: ugo+rw
Apr 17 05:31:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:03 devstack sudo[87049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce
Apr 17 05:31:03 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:04 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce" returned: 0 in 0.435s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.615s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-902144722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e785b8e1-a87b-4d50-a9ab-4bac2356e8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c74bc3886d4950b75b8318d357657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:30:57Z,use_quota=True,user_id='eab47e3051d943ed9b7a1c222c4eb85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Creating volume e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:04 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:04 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-919b46de-6152-4f33-9dba-fac5dcd6ddf0 tempest-VolumesDeleteCascade-199668281 None] Create snapshot completed successfully
Apr 17 05:31:04 devstack sudo[87052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 1073741824
Apr 17 05:31:04 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:04 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 1073741824" returned: 0 in 0.480s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:04 devstack sudo[87057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2
Apr 17 05:31:04 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:05 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" returned: 0 in 0.405s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.173s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-47071494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd04d5e18fdb4e65bf2c7bff04a0b9dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:00Z,use_quota=True,user_id='27c96521013a4317b1d00cbe844a1bc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Creating volume 9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:05 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd98d68e-8b7f-4817-807c-bcaaaebdbee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb105973-dcdb-4f45-b67a-93e6e01c8f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:05 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Volume volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 (e785b8e1-a87b-4d50-a9ab-4bac2356e8a2): created successfully
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb105973-dcdb-4f45-b67a-93e6e01c8f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Flow 'volume_create_manager' (e57aedc7-bbb3-463a-bb41-c58c8d8079dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:05 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f 1073741824
Apr 17 05:31:05 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:05 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-43d99fca-3af9-495a-bb2b-e3692086b570 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Created volume successfully.
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-fa52917a-a5fb-45e8-b101-d22bdb578227-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-fa52917a-a5fb-45e8-b101-d22bdb578227-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Performing cascade delete. {{(pid=82266) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-3e403449-bc7d-4199-825c-c30fdbf6bbce-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-3e403449-bc7d-4199-825c-c30fdbf6bbce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-fa52917a-a5fb-45e8-b101-d22bdb578227" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-fa52917a-a5fb-45e8-b101-d22bdb578227" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-3e403449-bc7d-4199-825c-c30fdbf6bbce" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-3e403449-bc7d-4199-825c-c30fdbf6bbce" acquired by "_delete_snapshot" :: waited 0.004s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Deleting offline snapshot 3e403449-bc7d-4199-825c-c30fdbf6bbce of volume fa52917a-a5fb-45e8-b101-d22bdb578227 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] snapshot_file for this snap is: volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d601f37-8424-4c09-bacb-5ea87fc53c98]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:05 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce
Apr 17 05:31:05 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:05 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f 1073741824" returned: 0 in 0.519s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:05 devstack sudo[87067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f
Apr 17 05:31:05 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:05 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce" returned: 0 in 0.507s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa52917a-a5fb-45e8-b101-d22bdb578227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8791cca-ce74-48a7-9f1c-74632ba54947]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:05 devstack sudo[87073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96
Apr 17 05:31:05 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:06 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" returned: 0 in 0.457s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.556s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17cc9cea-d037-4a42-9436-887629d6ce2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ad05d4-0e6f-4116-8916-44b63ab85620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e3c408-68c7-464f-adc9-f907aab7cc4a]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:06 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Volume volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f (9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f): created successfully
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ad05d4-0e6f-4116-8916-44b63ab85620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Flow 'volume_create_manager' (de3cd58d-9590-44ab-ba38-9cd1ca94966f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-a018c197-533a-4759-b7ae-9b9005dbffce req-31e56d3d-cc5e-44b8-a2e0-afdc3c64d3bf tempest-VolumesSnapshotsTestJSON-508511239 None] Created volume successfully.
Apr 17 05:31:06 devstack sudo[87076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369
Apr 17 05:31:06 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:06 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96" returned: 0 in 0.553s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa52917a-a5fb-45e8-b101-d22bdb578227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:06 devstack sudo[87081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce
Apr 17 05:31:06 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:06 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369" returned: 0 in 0.591s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[993bb6cc-25dc-43dc-bd61-9c3e1b8621e9]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:06 devstack sudo[87086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369
Apr 17 05:31:06 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:06 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce" returned: 0 in 0.523s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:06 devstack sudo[87091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce
Apr 17 05:31:06 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:07 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369" returned: 0 in 0.520s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:07 devstack sudo[87097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img
Apr 17 05:31:07 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:07 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.3e403449-bc7d-4199-825c-c30fdbf6bbce" returned: 0 in 0.442s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-3e403449-bc7d-4199-825c-c30fdbf6bbce" released by "_delete_snapshot" :: held 2.088s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-fa52917a-a5fb-45e8-b101-d22bdb578227" released by "delete_snapshot" :: held 2.098s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Created reservations ['82966f18-b5b2-44ed-bc5f-6eacba2997f0', '6c7a16b9-add4-4333-b76b-bc6480baf52d', 'a5174710-efc0-40c1-8eff-d256375ecf48', '60881d8a-ab09-4b57-8fb8-3c4967c907ca'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:07 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Delete snapshot completed successfully.
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-3e403449-bc7d-4199-825c-c30fdbf6bbce-delete_snapshot" released by "delete_snapshot" :: held 2.517s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-df08a7a6-181c-4f82-87ac-00811cd96c96-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-df08a7a6-181c-4f82-87ac-00811cd96c96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-fa52917a-a5fb-45e8-b101-d22bdb578227" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-fa52917a-a5fb-45e8-b101-d22bdb578227" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-df08a7a6-181c-4f82-87ac-00811cd96c96" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-df08a7a6-181c-4f82-87ac-00811cd96c96" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Deleting offline snapshot df08a7a6-181c-4f82-87ac-00811cd96c96 of volume fa52917a-a5fb-45e8-b101-d22bdb578227 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] snapshot_file for this snap is: volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[be04b735-ea62-4512-ac67-cd816f9200f5]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:08 devstack sudo[87110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96
Apr 17 05:31:08 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:09 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96" returned: 0 in 1.330s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa52917a-a5fb-45e8-b101-d22bdb578227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[96886591-f99c-4382-9578-5464ec4b9b33]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:09 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img" returned: 0 in 2.116s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad45888-c031-4845-812e-667b6f0a66e3]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:09 devstack sudo[87115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227
Apr 17 05:31:09 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:09 devstack sudo[87116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369
Apr 17 05:31:09 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:09 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227" returned: 0 in 0.481s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:09 devstack sudo[87124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96
Apr 17 05:31:09 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:09 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369" returned: 0 in 0.619s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:31:09 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Converted 1024.00 MB image at 483.58 MB/s
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] 9cd65b0a-7a30-4dee-9baa-d742b802afb9 was raw, converting to qcow2 {{(pid=82266) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b63c0-ff04-47f0-9e8f-db7fee7c865f]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:09 devstack sudo[87127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img
Apr 17 05:31:09 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:10 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:10 devstack sudo[87132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96
Apr 17 05:31:10 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:10 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img" returned: 0 in 0.463s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:10 devstack sudo[87136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img
Apr 17 05:31:10 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:10 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227.df08a7a6-181c-4f82-87ac-00811cd96c96" returned: 0 in 0.422s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-df08a7a6-181c-4f82-87ac-00811cd96c96" released by "_delete_snapshot" :: held 2.783s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-fa52917a-a5fb-45e8-b101-d22bdb578227" released by "delete_snapshot" :: held 2.807s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Created reservations ['5625cf58-a9a6-426f-8cc3-c03133881ea8', 'a9f32afc-e5a8-45ef-bdb9-fd6ffb9c68b6', '27fd9c41-94f5-4d19-858a-9fb8faad8c4b', 'c91fd064-79c7-4c71-b0bd-457b107d2f0e'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:10 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Delete snapshot completed successfully.
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-df08a7a6-181c-4f82-87ac-00811cd96c96-delete_snapshot" released by "delete_snapshot" :: held 2.933s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Snapshots deleted, issuing volume delete {{(pid=82266) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-fa52917a-a5fb-45e8-b101-d22bdb578227" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-fa52917a-a5fb-45e8-b101-d22bdb578227" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4310ee-5d9e-44b2-8c55-60ce32fb8a38]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:10 devstack sudo[87139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227
Apr 17 05:31:10 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:10 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img" returned: 1 in 0.491s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:31:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img /opt/stack/data/cinder/conversion/vol_upload_gflv6jkg {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:10 devstack sudo[87144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img /opt/stack/data/cinder/conversion/vol_upload_gflv6jkg
Apr 17 05:31:10 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:11 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227" returned: 0 in 0.474s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:11 devstack sudo[87149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227
Apr 17 05:31:11 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:11 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img /opt/stack/data/cinder/conversion/vol_upload_gflv6jkg" returned: 0 in 0.424s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Image conversion details: src /opt/stack/data/cinder/conversion/a0de8fd6-07be-4c3b-985a-bd94e1233369.temp_image.9cd65b0a-7a30-4dee-9baa-d742b802afb9nbnu7h2b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gflv6jkg {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:31:11 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9371eaef-b72c-4293-bf56-df224ffaa593]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gflv6jkg {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:11 devstack sudo[87154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gflv6jkg
Apr 17 05:31:11 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:11 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fa52917a-a5fb-45e8-b101-d22bdb578227" returned: 0 in 0.421s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-fa52917a-a5fb-45e8-b101-d22bdb578227" released by "delete_volume" :: held 0.926s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Created reservations ['18c4088a-a241-4386-8adc-ceaaa9ad924d', '12f5be6c-0488-40ec-b7aa-2c64cf4a388e', '082819df-a99e-4d35-a595-88611fe0da27', '447af427-5622-4dbe-8cc3-de0158a0b4c5'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:11 devstack sudo[87160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:11 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:11 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gflv6jkg" returned: 0 in 0.481s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:12 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.447s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:12 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:12 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Deleted volume successfully.
Apr 17 05:31:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-137147f1-5dbf-41d5-8b40-12101153ff6f tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-fa52917a-a5fb-45e8-b101-d22bdb578227-delete_volume" released by "delete_volume" :: held 6.999s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.559s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Uploaded volume to glance image-id: 9cd65b0a-7a30-4dee-9baa-d742b802afb9. {{(pid=82266) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 17 05:31:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.638s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Creating offline snapshot 773d7db8-1843-4871-b5d3-8c056d7aae03 of volume e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:31:12 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8a7c9441-76b4-49cf-b1f8-c8f91f5f38d6 tempest-VolumesActionsTest-730828754 None] Copy volume to image completed successfully.
Apr 17 05:31:12 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e126b590-ec64-4607-a0d5-cdf20996659e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:12 devstack sudo[87163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2
Apr 17 05:31:12 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Flow 'volume_create_manager' (3c743148-8a45-49d0-86a6-24ac64f25cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9a3cce-6efa-4e6f-914f-b2e0ba4d4184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9a3cce-6efa-4e6f-914f-b2e0ba4d4184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-208597991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1843573d-4450-4f32-9326-aa7e500ebfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9373efc7f2094cb08eebad10c8ee68f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:13Z,use_quota=True,user_id='7a5813c67c1545ad88005d44c1ff2c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d264d170-2767-48be-99f2-d8f7f8ba6866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d264d170-2767-48be-99f2-d8f7f8ba6866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb9803e-ecce-42df-9db1-a32d5efeac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb9803e-ecce-42df-9db1-a32d5efeac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1843573d-4450-4f32-9326-aa7e500ebfa8', 'volume_name': 'volume-1843573d-4450-4f32-9326-aa7e500ebfa8', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2722d58-9733-4188-8108-bbf71cbff14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2722d58-9733-4188-8108-bbf71cbff14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8562b8bd-5df2-4ae2-8ba1-9797ccf01b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:13 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Volume 1843573d-4450-4f32-9326-aa7e500ebfa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1843573d-4450-4f32-9326-aa7e500ebfa8', 'volume_size': 1}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:13 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" returned: 0 in 0.572s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:13 devstack sudo[87168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03 1G
Apr 17 05:31:13 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Acquiring lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Acquiring lock "cinder-quobyte-a0de8fd6-07be-4c3b-985a-bd94e1233369" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Lock "cinder-quobyte-a0de8fd6-07be-4c3b-985a-bd94e1233369" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd2c7d-08af-473d-ac4b-3e58e65ee134]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:13 devstack sudo[87170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369
Apr 17 05:31:13 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:13 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03 1G" returned: 0 in 0.467s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:13 devstack sudo[87175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03
Apr 17 05:31:13 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:13 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369" returned: 0 in 0.483s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:13 devstack sudo[87180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369
Apr 17 05:31:13 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:14 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03" returned: 0 in 0.476s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:14 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03 is being set with open permissions: ugo+rw
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:14 devstack sudo[87185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03
Apr 17 05:31:14 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:14 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a0de8fd6-07be-4c3b-985a-bd94e1233369" returned: 0 in 0.429s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Lock "cinder-quobyte-a0de8fd6-07be-4c3b-985a-bd94e1233369" released by "delete_volume" :: held 0.932s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Created reservations ['e87a1663-67d1-4555-b6e8-3ebc5cf564ce', 'f3f8d324-d5a1-4950-b532-8aaec212e7ac', '1197efbf-6f72-41ee-8082-a43b25da21f1', 'f526de42-f941-4cbf-9632-b1c0c3a0cc79'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:14 devstack sudo[87188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:14 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:14 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03" returned: 0 in 0.441s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:14 devstack sudo[87191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.info
Apr 17 05:31:14 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:14 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.444s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Deleted volume successfully.
Apr 17 05:31:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-35512f69-db30-4933-876f-f61d7942b5dc tempest-VolumesActionsTest-730828754 None] Lock "cinder-a0de8fd6-07be-4c3b-985a-bd94e1233369-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:15 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.info" returned: 0 in 0.446s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:15 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.info is being set with open permissions: ugo+rw
Apr 17 05:31:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:15 devstack sudo[87195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.info
Apr 17 05:31:15 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:15 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.info" returned: 0 in 0.417s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.887s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.117s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Creating offline snapshot 0ef3ab84-bae3-49f1-952c-d9d97d32f407 of volume 9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:31:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[431e6874-787d-4829-aae3-01ef69ccdc4c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4edb6160-6a0f-4a70-8657-c4831c55b7b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Create snapshot completed successfully
Apr 17 05:31:15 devstack sudo[87198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f
Apr 17 05:31:15 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:16 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" returned: 0 in 0.550s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:16 devstack sudo[87204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407 1G
Apr 17 05:31:16 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Acquiring lock "cinder-773d7db8-1843-4871-b5d3-8c056d7aae03-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "cinder-773d7db8-1843-4871-b5d3-8c056d7aae03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Acquiring lock "cinder-quobyte-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "cinder-quobyte-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Acquiring lock "cinder-quobyte-773d7db8-1843-4871-b5d3-8c056d7aae03" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:16 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "cinder-quobyte-773d7db8-1843-4871-b5d3-8c056d7aae03" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Deleting offline snapshot 773d7db8-1843-4871-b5d3-8c056d7aae03 of volume e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] snapshot_file for this snap is: volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407 1G" returned: 0 in 0.704s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec6e58a-ceda-4d50-9df7-b526ba657613]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:16 devstack sudo[87209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407
Apr 17 05:31:16 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:16 devstack sudo[87210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03
Apr 17 05:31:16 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:17 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407" returned: 0 in 0.557s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:17 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407 is being set with open permissions: ugo+rw
Apr 17 05:31:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:17 devstack sudo[87220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407
Apr 17 05:31:17 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:17 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03" returned: 0 in 0.576s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:31:17 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[13948be7-7739-4656-8409-c7c1c30e60bd]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:17 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2
Apr 17 05:31:17 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:17 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407" returned: 0 in 0.518s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:17 devstack sudo[87229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.info
Apr 17 05:31:17 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:17 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" returned: 0 in 0.539s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:17 devstack sudo[87231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03
Apr 17 05:31:17 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:18 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.info" returned: 0 in 0.495s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:18 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.info is being set with open permissions: ugo+rw
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:18 devstack sudo[87237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.info
Apr 17 05:31:18 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:18 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03" returned: 0 in 0.506s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:18 devstack sudo[87239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03
Apr 17 05:31:18 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:18 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.info" returned: 0 in 0.444s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.335s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.726s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-208597991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1843573d-4450-4f32-9326-aa7e500ebfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9373efc7f2094cb08eebad10c8ee68f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:13Z,use_quota=True,user_id='7a5813c67c1545ad88005d44c1ff2c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Creating volume 1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:18 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:18 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:18 devstack sudo[87243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 1073741824
Apr 17 05:31:18 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2.773d7db8-1843-4871-b5d3-8c056d7aae03" returned: 0 in 0.436s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:18 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-85b42b9b-88e5-46f6-9fa9-558246b45edc req-50900835-89bf-46f4-8aee-1a6892509b3d tempest-VolumesSnapshotsTestJSON-508511239 None] Create snapshot completed successfully
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "cinder-quobyte-773d7db8-1843-4871-b5d3-8c056d7aae03" released by "_delete_snapshot" :: held 2.159s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "cinder-quobyte-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" released by "delete_snapshot" :: held 2.172s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Created reservations ['9d58b3ff-4e23-49b9-9668-d59ee704f712', '0bf18b9b-1d34-4577-9cca-c23d74c038da', '46730ac3-b2f8-4bd0-85f3-4c5c92837b0f', 'a135a79d-ec91-403c-a1fa-34a3a3aa844e'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:18 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Delete snapshot completed successfully.
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4d5d6431-abda-4f2d-a69c-48f7c6a058c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "cinder-773d7db8-1843-4871-b5d3-8c056d7aae03-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:18 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Flow 'volume_create_manager' (5732b701-8665-4cd3-b3c9-ef8c94e2cb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fca300-20fd-4f3a-a9f3-9a40d119d059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fca300-20fd-4f3a-a9f3-9a40d119d059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1369049562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9636ded-bac3-4363-ba8f-64e61df88c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a851f6b1fd554ebda3814673056b778b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:19Z,use_quota=True,user_id='840b3082ee1b4acba70158e8b3f37ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb79710b-6512-4b11-802c-dd6808c22d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb79710b-6512-4b11-802c-dd6808c22d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fe3666-4720-4516-a9de-642fa19c9a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fe3666-4720-4516-a9de-642fa19c9a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9636ded-bac3-4363-ba8f-64e61df88c36', 'volume_name': 'volume-f9636ded-bac3-4363-ba8f-64e61df88c36', 'volume_size': 2}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543e87f0-4c1f-48ad-a264-a141666d0d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543e87f0-4c1f-48ad-a264-a141666d0d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149a598f-50c9-4211-831a-7d9ecc307b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:19 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Volume f9636ded-bac3-4363-ba8f-64e61df88c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9636ded-bac3-4363-ba8f-64e61df88c36', 'volume_size': 2}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Acquiring lock "cinder-0ef3ab84-bae3-49f1-952c-d9d97d32f407-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "cinder-0ef3ab84-bae3-49f1-952c-d9d97d32f407-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Acquiring lock "cinder-quobyte-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "cinder-quobyte-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Acquiring lock "cinder-quobyte-0ef3ab84-bae3-49f1-952c-d9d97d32f407" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "cinder-quobyte-0ef3ab84-bae3-49f1-952c-d9d97d32f407" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Deleting offline snapshot 0ef3ab84-bae3-49f1-952c-d9d97d32f407 of volume 9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] snapshot_file for this snap is: volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a551b673-d61c-46a0-9c32-4b49c1e0f393]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:19 devstack sudo[87245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407
Apr 17 05:31:19 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:19 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 1073741824" returned: 0 in 0.584s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:19 devstack sudo[87250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8
Apr 17 05:31:19 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:19 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407" returned: 0 in 0.518s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb8f710-f419-4c8e-8524-24aac32f21e1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:19 devstack sudo[87256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f
Apr 17 05:31:19 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:19 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1369049562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9636ded-bac3-4363-ba8f-64e61df88c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a851f6b1fd554ebda3814673056b778b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:19Z,use_quota=True,user_id='840b3082ee1b4acba70158e8b3f37ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Creating volume f9636ded-bac3-4363-ba8f-64e61df88c36 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:19 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36 2147483648 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8562b8bd-5df2-4ae2-8ba1-9797ccf01b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1843573d-4450-4f32-9326-aa7e500ebfa8', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:19 devstack sudo[87258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36 2147483648
Apr 17 05:31:19 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b6f098-972d-426c-ae43-e9bda26f1674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Acquiring lock "cinder-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:19 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Volume volume-1843573d-4450-4f32-9326-aa7e500ebfa8 (1843573d-4450-4f32-9326-aa7e500ebfa8): created successfully
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b6f098-972d-426c-ae43-e9bda26f1674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Flow 'volume_create_manager' (3c743148-8a45-49d0-86a6-24ac64f25cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "cinder-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:19 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-fb0ea369-92d1-4b25-a08e-9b09d530cf8b tempest-VolumesDeleteCascade-199668281 None] Created volume successfully.
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Acquiring lock "cinder-quobyte-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "cinder-quobyte-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef0ae0d-e7bf-4b65-a9f9-feadd9cf92bd]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:20 devstack sudo[87260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2
Apr 17 05:31:20 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:20 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:20 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407
Apr 17 05:31:20 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:20 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36 2147483648" returned: 0 in 0.621s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:20 devstack sudo[87273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36
Apr 17 05:31:20 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:20 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" returned: 0 in 0.561s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:20 devstack sudo[87275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2
Apr 17 05:31:20 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:20 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407" returned: 0 in 0.519s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:20 devstack sudo[87280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407
Apr 17 05:31:20 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:20 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" returned: 0 in 0.421s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "cinder-quobyte-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2" released by "delete_volume" :: held 1.019s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:21 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36" returned: 0 in 0.474s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.484s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149a598f-50c9-4211-831a-7d9ecc307b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9636ded-bac3-4363-ba8f-64e61df88c36', 'volume_size': 2}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2bea6f-6f1d-42b0-854e-709d0f356dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:21 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Volume volume-f9636ded-bac3-4363-ba8f-64e61df88c36 (f9636ded-bac3-4363-ba8f-64e61df88c36): created successfully
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2bea6f-6f1d-42b0-854e-709d0f356dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Flow 'volume_create_manager' (5732b701-8665-4cd3-b3c9-ef8c94e2cb55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:21 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5e8f2c99-b3b0-49aa-956b-1841512e63fc tempest-VolumesCloneNegativeTest-284744511 None] Created volume successfully.
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Creating offline snapshot 60e68514-5647-414b-804f-567032ac802c of volume 1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d60492b-6bbc-40a5-8009-17d2da69ea88]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Created reservations ['c2413c38-b22f-4371-afac-dbf2cc93d1bb', 'a77919e6-1508-4f4d-8a90-7127fd23e710', '378b7645-2dde-49a3-8463-e8c58ba97035', '839fc38b-a246-4c18-ace3-2acf7331984b'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:21 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f.0ef3ab84-bae3-49f1-952c-d9d97d32f407" returned: 0 in 0.409s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:21 devstack sudo[87287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:21 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:21 devstack sudo[87286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8
Apr 17 05:31:21 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "cinder-quobyte-0ef3ab84-bae3-49f1-952c-d9d97d32f407" released by "_delete_snapshot" :: held 2.000s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "cinder-quobyte-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" released by "delete_snapshot" :: held 2.017s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Acquiring lock "cinder-f9636ded-bac3-4363-ba8f-64e61df88c36-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Lock "cinder-f9636ded-bac3-4363-ba8f-64e61df88c36-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.quota [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Created reservations ['deff04b7-cac0-45b1-a873-27dcb9327b99', 'c8c6b26f-7a56-47c1-8382-84234d53662b', '676c3547-a89f-4e03-8c7c-c209faab1e72', 'f155350a-c474-43c3-8ae3-e99bfa8e9bf5'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Acquiring lock "cinder-quobyte-f9636ded-bac3-4363-ba8f-64e61df88c36" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Lock "cinder-quobyte-f9636ded-bac3-4363-ba8f-64e61df88c36" acquired by "delete_volume" :: waited 0.017s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6809e1bb-6c4e-4eb1-8c26-9175b663f80c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:21 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Delete snapshot completed successfully.
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-37828498-7c34-4b3f-be73-4f4b23269df1 req-6da2e181-e161-4cdc-8e58-c9190797048f tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "cinder-0ef3ab84-bae3-49f1-952c-d9d97d32f407-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Acquiring lock "cinder-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "cinder-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Acquiring lock "cinder-quobyte-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "cinder-quobyte-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80d06e7-a4b4-4d0e-8f62-9d5e2c338d79]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:21 devstack sudo[87290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36
Apr 17 05:31:21 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:21 devstack sudo[87291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f
Apr 17 05:31:21 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:21 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.453s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:21 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Deleted volume successfully.
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1fbba1e9-23d6-40ee-8976-a2ba3ba06934 tempest-VolumeSnapshotQuotasNegativeTestJSON-996842630 None] Lock "cinder-e785b8e1-a87b-4d50-a9ab-4bac2356e8a2-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:21 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8" returned: 0 in 0.627s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:21 devstack sudo[87298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c 1G
Apr 17 05:31:21 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:21 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36" returned: 0 in 0.578s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:21 devstack sudo[87306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36
Apr 17 05:31:21 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:22 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" returned: 0 in 0.498s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:22 devstack sudo[87309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f
Apr 17 05:31:22 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:22 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c 1G" returned: 0 in 0.574s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1843573d-4450-4f32-9326-aa7e500ebfa8 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:22 devstack sudo[87314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1843573d-4450-4f32-9326-aa7e500ebfa8 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c
Apr 17 05:31:22 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:22 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f9636ded-bac3-4363-ba8f-64e61df88c36" returned: 0 in 0.507s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Lock "cinder-quobyte-f9636ded-bac3-4363-ba8f-64e61df88c36" released by "delete_volume" :: held 1.114s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Created reservations ['18edb7b0-bfa1-4a45-9f84-c399d90935d5', 'fd71664c-9560-4e1f-a34c-b6708fd87546', '923c0140-f55a-430e-bfa1-4a79df7dbd96', '5520335f-8f53-4b34-8fe5-346df24e2c9b'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:22 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:22 devstack sudo[87318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:22 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" returned: 0 in 0.593s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "cinder-quobyte-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f" released by "delete_volume" :: held 1.124s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG cinder.quota [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Created reservations ['d5123cab-0119-4f4a-a5b2-2bb17a1ade86', '51e534ff-dee8-48dd-ad32-188ba31ac495', '005bc929-1c77-488d-8597-48e53f23a4b3', 'bc7d48af-c1d1-4575-a688-72a3d240ddc1'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:22 devstack sudo[87320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:22 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:22 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1843573d-4450-4f32-9326-aa7e500ebfa8 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c" returned: 0 in 0.564s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:22 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c is being set with open permissions: ugo+rw
Apr 17 05:31:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:22 devstack sudo[87325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c
Apr 17 05:31:22 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:23 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.504s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:23 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:23 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Deleted volume successfully.
Apr 17 05:31:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-78760f62-7d15-4a31-bfe7-25bbd8821727 tempest-VolumesCloneNegativeTest-284744511 None] Lock "cinder-f9636ded-bac3-4363-ba8f-64e61df88c36-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:23 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.510s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:23 devstack cinder-volume[82266]: DEBUG cinder.manager [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:23 devstack cinder-volume[82266]: INFO cinder.volume.manager [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Deleted volume successfully.
Apr 17 05:31:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [req-434719b3-45a6-4eb5-aac5-95942f7fb215 req-792b12a5-c93b-492a-8112-a5f7743a785a tempest-VolumesSnapshotsTestJSON-508511239 None] Lock "cinder-9afa3d0e-0a3d-4fe4-9537-10ce971cbf7f-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:23 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c" returned: 0 in 0.469s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:23 devstack sudo[87330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.info
Apr 17 05:31:23 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:23 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.info" returned: 0 in 0.557s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:23 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.info is being set with open permissions: ugo+rw
Apr 17 05:31:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:23 devstack sudo[87333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.info
Apr 17 05:31:23 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:24 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.info" returned: 0 in 0.644s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.560s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:24 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-15b2e6f3-318a-4a22-b84f-a2549f06f9d3 tempest-VolumesDeleteCascade-199668281 None] Create snapshot completed successfully
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Flow 'volume_create_manager' (6c60d1ea-25cf-42a8-abcd-89671b3832aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a10aae-7483-44cd-9192-2cde282ff939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a10aae-7483-44cd-9192-2cde282ff939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1800592704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7a7d8d-616c-4983-b3cf-b7a56d88daca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9373efc7f2094cb08eebad10c8ee68f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60e68514-5647-414b-804f-567032ac802c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:25Z,use_quota=True,user_id='7a5813c67c1545ad88005d44c1ff2c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd2a699-1594-40db-87cc-eb5948b976d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd2a699-1594-40db-87cc-eb5948b976d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe3ef72-f556-409e-8f89-c79a374902d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe3ef72-f556-409e-8f89-c79a374902d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df7a7d8d-616c-4983-b3cf-b7a56d88daca', 'volume_name': 'volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca', 'volume_size': 1, 'snapshot_id': '60e68514-5647-414b-804f-567032ac802c'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb47c94-7ff5-4285-9b0d-d4563528599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb47c94-7ff5-4285-9b0d-d4563528599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8709e3b7-7f14-4e14-a600-80347e3269f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:25 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Volume df7a7d8d-616c-4983-b3cf-b7a56d88daca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca', 'volume_size': 1, 'snapshot_id': '60e68514-5647-414b-804f-567032ac802c'}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-60e68514-5647-414b-804f-567032ac802c-df7a7d8d-616c-4983-b3cf-b7a56d88daca" by "_create_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-60e68514-5647-414b-804f-567032ac802c-df7a7d8d-616c-4983-b3cf-b7a56d88daca" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Creating volume df7a7d8d-616c-4983-b3cf-b7a56d88daca from snapshot 60e68514-5647-414b-804f-567032ac802c {{(pid=82266) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-df7a7d8d-616c-4983-b3cf-b7a56d88daca" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-df7a7d8d-616c-4983-b3cf-b7a56d88daca" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] snapshot: 60e68514-5647-414b-804f-567032ac802c, volume: df7a7d8d-616c-4983-b3cf-b7a56d88daca,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8739c76-ee3f-4a07-b592-5cbb74046194]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:25 devstack sudo[87336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c
Apr 17 05:31:25 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:25 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c" returned: 0 in 0.571s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1843573d-4450-4f32-9326-aa7e500ebfa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c56154-1037-4487-b6a9-e85ed025209d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:25 devstack sudo[87343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8
Apr 17 05:31:25 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Flow 'volume_create_manager' (1c092674-3c77-4058-a6f0-aa5cee330310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c729e977-d421-4355-841a-5340135562f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c729e977-d421-4355-841a-5340135562f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1746577901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84fa43f-ed82-4e76-adfe-2bc3f883b393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f6611cb53144bb9d770cfb8326ad19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:26Z,use_quota=True,user_id='5dcafe3a1619474d84a755a00415c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d65b5f2-1c93-4bea-9b5b-5fb3eec78a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d65b5f2-1c93-4bea-9b5b-5fb3eec78a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90df1829-6f55-4348-9783-ed821f8e52ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.image.glance [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Creating Keystone auth plugin from conf {{(pid=82266) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 17 05:31:26 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8" returned: 0 in 0.681s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:26 devstack sudo[87348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca
Apr 17 05:31:26 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90df1829-6f55-4348-9783-ed821f8e52ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c84fa43f-ed82-4e76-adfe-2bc3f883b393', 'volume_name': 'volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536d6752d0>}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104d15ab-7180-44d0-9d2f-dfc3542e8136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104d15ab-7180-44d0-9d2f-dfc3542e8136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a59e29-87e7-43d8-a867-cd5964afb173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:26 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Volume c84fa43f-ed82-4e76-adfe-2bc3f883b393: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536d6752d0>}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Trying to clone c84fa43f-ed82-4e76-adfe-2bc3f883b393 from image f11dd628-d05d-412e-b4ef-be70c4399345 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]). {{(pid=82266) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Flow 'volume_create_manager' (eb1efc9d-9b18-4105-8522-4186ad05ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4378e22b-af09-410b-89bc-f996a7800207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4378e22b-af09-410b-89bc-f996a7800207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-981850239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a90155d-bcb5-4f4b-a071-555c75b785ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1d91ed45084e009f1085071d2a7a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:27Z,use_quota=True,user_id='7c93ca887e49432299a61ad393adaede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd70c10-8246-42fa-8bc8-3358b42685db),volume_type_id=8fd70c10-8246-42fa-8bc8-3358b42685db)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d35f8d8-5e95-42f7-899c-ebe2648eef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d35f8d8-5e95-42f7-899c-ebe2648eef17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97524d3-fe9c-46a9-955c-9cdf7556878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97524d3-fe9c-46a9-955c-9cdf7556878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a90155d-bcb5-4f4b-a071-555c75b785ed', 'volume_name': 'volume-7a90155d-bcb5-4f4b-a071-555c75b785ed', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a119ef-c21d-4dfc-bfe2-7f60560053c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a119ef-c21d-4dfc-bfe2-7f60560053c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5169b4bf-6c08-4475-bd97-e6d1eabc631f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:27 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Volume 7a90155d-bcb5-4f4b-a071-555c75b785ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a90155d-bcb5-4f4b-a071-555c75b785ed', 'volume_size': 1}
Apr 17 05:31:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:27 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 17 05:31:27 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Image download 20.69 MB at 20.69 MB/s
Apr 17 05:31:27 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb868ed4-6b15-42ab-a860-ce70315c04c7]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:27 devstack sudo[87362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD
Apr 17 05:31:27 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:28 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD" returned: 0 in 1.283s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:28 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Temporary image f11dd628-d05d-412e-b4ef-be70c4399345 is fetched for user 5dcafe3a1619474d84a755a00415c91a. {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 17 05:31:28 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[39557adc-cc97-459d-afc9-979cf1e186c2]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:28 devstack sudo[87367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD
Apr 17 05:31:28 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:28 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca" returned: 0 in 2.371s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:28 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab79cb12-e2cf-4e85-813e-3e44052ee4c0]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:28 devstack sudo[87369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8
Apr 17 05:31:28 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:29 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:29 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8" returned: 0 in 0.690s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:29 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:31:29 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Converted 1024.00 MB image at 431.50 MB/s
Apr 17 05:31:29 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca is being set with open permissions: ugo+rw
Apr 17 05:31:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:29 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca
Apr 17 05:31:29 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:30 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca" returned: 0 in 0.444s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-df7a7d8d-616c-4983-b3cf-b7a56d88daca" released by "_copy_volume_from_snapshot" :: held 4.838s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-60e68514-5647-414b-804f-567032ac802c-df7a7d8d-616c-4983-b3cf-b7a56d88daca" released by "_create_volume_from_snapshot" :: held 4.857s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.866s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.899s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-981850239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a90155d-bcb5-4f4b-a071-555c75b785ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1d91ed45084e009f1085071d2a7a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:27Z,use_quota=True,user_id='7c93ca887e49432299a61ad393adaede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd70c10-8246-42fa-8bc8-3358b42685db),volume_type_id=8fd70c10-8246-42fa-8bc8-3358b42685db)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Creating volume 7a90155d-bcb5-4f4b-a071-555c75b785ed {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:30 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:30 devstack sudo[87381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed 1073741824
Apr 17 05:31:30 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8709e3b7-7f14-4e14-a600-80347e3269f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca', 'volume_size': 1, 'snapshot_id': '60e68514-5647-414b-804f-567032ac802c'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241b2b5f-89b7-487f-906d-edf1df07bb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:30 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Volume volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca (df7a7d8d-616c-4983-b3cf-b7a56d88daca): created successfully
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241b2b5f-89b7-487f-906d-edf1df07bb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Flow 'volume_create_manager' (6c60d1ea-25cf-42a8-abcd-89671b3832aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:30 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e48e85b4-3735-4fc5-b897-aeb5dbed2422 tempest-VolumesDeleteCascade-199668281 None] Created volume successfully.
Apr 17 05:31:30 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed 1073741824" returned: 0 in 0.516s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:30 devstack sudo[87386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed
Apr 17 05:31:30 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-1843573d-4450-4f32-9326-aa7e500ebfa8-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-1843573d-4450-4f32-9326-aa7e500ebfa8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Performing cascade delete. {{(pid=82266) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-60e68514-5647-414b-804f-567032ac802c-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-60e68514-5647-414b-804f-567032ac802c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-1843573d-4450-4f32-9326-aa7e500ebfa8" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-1843573d-4450-4f32-9326-aa7e500ebfa8" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-60e68514-5647-414b-804f-567032ac802c" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-60e68514-5647-414b-804f-567032ac802c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Deleting offline snapshot 60e68514-5647-414b-804f-567032ac802c of volume 1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] snapshot_file for this snap is: volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[275ea485-0871-4462-bea9-02015a63b23d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:30 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c
Apr 17 05:31:30 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:31 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed" returned: 0 in 0.498s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.786s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1746577901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84fa43f-ed82-4e76-adfe-2bc3f883b393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f6611cb53144bb9d770cfb8326ad19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:26Z,use_quota=True,user_id='5dcafe3a1619474d84a755a00415c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Creating volume c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:31 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5169b4bf-6c08-4475-bd97-e6d1eabc631f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a90155d-bcb5-4f4b-a071-555c75b785ed', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084b4a4e-9685-426a-abdb-cf7dc3e03a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:31 devstack sudo[87391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 1073741824
Apr 17 05:31:31 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Volume volume-7a90155d-bcb5-4f4b-a071-555c75b785ed (7a90155d-bcb5-4f4b-a071-555c75b785ed): created successfully
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084b4a4e-9685-426a-abdb-cf7dc3e03a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Flow 'volume_create_manager' (eb1efc9d-9b18-4105-8522-4186ad05ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:31 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7800fcd1-57df-454a-8300-3f8a8a983363 tempest-VolumeTypesAccessTest-471960475 None] Created volume successfully.
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Acquiring lock "cinder-7a90155d-bcb5-4f4b-a071-555c75b785ed-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Lock "cinder-7a90155d-bcb5-4f4b-a071-555c75b785ed-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:31 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c" returned: 0 in 0.547s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1843573d-4450-4f32-9326-aa7e500ebfa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f162d7b4-2373-4b91-963a-95ebfe37dc05]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Acquiring lock "cinder-quobyte-7a90155d-bcb5-4f4b-a071-555c75b785ed" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Lock "cinder-quobyte-7a90155d-bcb5-4f4b-a071-555c75b785ed" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e979f7e-ffe9-422f-92c4-53d7220291a6]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:31 devstack sudo[87396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8
Apr 17 05:31:31 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:31 devstack sudo[87397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed
Apr 17 05:31:31 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Flow 'volume_create_manager' (5e07b3ef-381a-48ee-b660-019f7b66dfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce54429-9c04-4e5b-bf61-df66045a4f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce54429-9c04-4e5b-bf61-df66045a4f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-444538569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bc9f5b-ece0-46c1-825f-e7a693549c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1657fc5dac1e479aa846e8985bd5c0f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:32Z,use_quota=True,user_id='9684336cee1c4aef82afe0e06e8269f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e8a5ff-f6f0-4a2b-8239-8bce4848f975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e8a5ff-f6f0-4a2b-8239-8bce4848f975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8776907-04d9-44e3-a520-eba90bfaa09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8776907-04d9-44e3-a520-eba90bfaa09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3bc9f5b-ece0-46c1-825f-e7a693549c47', 'volume_name': 'volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25a7a63-c662-4fd5-aa91-53f92eb61dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25a7a63-c662-4fd5-aa91-53f92eb61dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:31 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759b36e5-2eeb-4129-ac47-cd903936394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Volume b3bc9f5b-ece0-46c1-825f-e7a693549c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47', 'volume_size': 1}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 1073741824" returned: 0 in 0.643s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:31 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393
Apr 17 05:31:31 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:31 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8" returned: 0 in 0.539s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:31 devstack sudo[87411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c
Apr 17 05:31:31 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:31 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed" returned: 0 in 0.558s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:32 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed
Apr 17 05:31:32 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:32 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393" returned: 0 in 0.459s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-444538569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bc9f5b-ece0-46c1-825f-e7a693549c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1657fc5dac1e479aa846e8985bd5c0f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:32Z,use_quota=True,user_id='9684336cee1c4aef82afe0e06e8269f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Creating volume b3bc9f5b-ece0-46c1-825f-e7a693549c47 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:32 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:32 devstack sudo[87416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47 1073741824
Apr 17 05:31:32 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Attempting download of f11dd628-d05d-412e-b4ef-be70c4399345 ((None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}])) to volume c84fa43f-ed82-4e76-adfe-2bc3f883b393. {{(pid=82266) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd188a6a-bf55-41fc-9a07-140c3e9484b7]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_w97b0br9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:32 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_w97b0br9
Apr 17 05:31:32 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:32 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a90155d-bcb5-4f4b-a071-555c75b785ed" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Lock "cinder-quobyte-7a90155d-bcb5-4f4b-a071-555c75b785ed" released by "delete_volume" :: held 1.001s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:32 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c" returned: 0 in 0.530s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:32 devstack cinder-volume[82266]: WARNING cinder.quota [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2142738285 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2142738285, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:31:32 devstack cinder-volume[82266]: WARNING cinder.quota [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2142738285 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2142738285, it is now deprecated. Please use the default quota class for default quota.
Apr 17 05:31:32 devstack sudo[87424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c
Apr 17 05:31:32 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Created reservations ['9bcf0369-c7cf-4b73-930a-e17b3bdac15c', '46bc521c-af38-42b0-8239-12eabb543787', '8120e840-d86b-417e-b6af-0f333630b1f5', '943506a6-8566-4126-83f6-481881834852'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:32 devstack sudo[87426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:32 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:32 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47 1073741824" returned: 0 in 0.573s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:32 devstack sudo[87434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47
Apr 17 05:31:32 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:32 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_w97b0br9" returned: 0 in 0.568s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_w97b0br9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:32 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8.60e68514-5647-414b-804f-567032ac802c" returned: 0 in 0.480s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-60e68514-5647-414b-804f-567032ac802c" released by "_delete_snapshot" :: held 2.149s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-1843573d-4450-4f32-9326-aa7e500ebfa8" released by "delete_snapshot" :: held 2.160s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:32 devstack sudo[87436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_w97b0br9
Apr 17 05:31:32 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Created reservations ['7bde4a72-48b9-4ac3-be94-8a29aff39c54', '9316bdd8-f94d-4732-9a50-3aaa4e364a93', '0706e15f-b649-479c-9045-904487e8d3aa', '46e03c0d-444f-481f-a14a-ae5ceda7a995'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:32 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.483s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Deleted volume successfully.
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-186f6b5f-7690-44c6-82ff-a895ea894afc tempest-VolumeTypesAccessTest-471960475 None] Lock "cinder-7a90155d-bcb5-4f4b-a071-555c75b785ed-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Delete snapshot completed successfully.
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-60e68514-5647-414b-804f-567032ac802c-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Snapshots deleted, issuing volume delete {{(pid=82266) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-1843573d-4450-4f32-9326-aa7e500ebfa8" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-1843573d-4450-4f32-9326-aa7e500ebfa8" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b384635-c8ab-43e6-aaed-63b40a2083e1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:33 devstack sudo[87439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8
Apr 17 05:31:33 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:33 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47" returned: 0 in 0.461s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759b36e5-2eeb-4129-ac47-cd903936394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e308a9ca-cddd-4b8c-93a7-d9c0ec8b5f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:33 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Volume volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47 (b3bc9f5b-ece0-46c1-825f-e7a693549c47): created successfully
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e308a9ca-cddd-4b8c-93a7-d9c0ec8b5f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Flow 'volume_create_manager' (5e07b3ef-381a-48ee-b660-019f7b66dfd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7d5bc034-9d60-48b4-a226-46fefa728aeb tempest-VolumeQuotasNegativeTestJSON-982609891 None] Created volume successfully.
Apr 17 05:31:33 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_w97b0br9" returned: 1 in 0.545s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_w97b0br9' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cea408-04c6-4ea7-ab81-98689c962de3]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:33 devstack sudo[87444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD
Apr 17 05:31:33 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:33 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8" returned: 0 in 0.517s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:33 devstack sudo[87449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8
Apr 17 05:31:33 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:33 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] f11dd628-d05d-412e-b4ef-be70c4399345 was qcow2, converting to raw {{(pid=82266) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 17 05:31:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:33 devstack sudo[87455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393
Apr 17 05:31:33 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:34 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1843573d-4450-4f32-9326-aa7e500ebfa8" returned: 0 in 0.489s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-1843573d-4450-4f32-9326-aa7e500ebfa8" released by "delete_volume" :: held 1.036s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Created reservations ['0bd25e82-9e4e-4522-a4ab-458df490572f', '82a453db-de6b-4dcf-89dd-8a36cd8685ef', '8fc8e4e4-c034-4504-9e7a-c897d0986173', 'a3fb7ecb-a422-40ea-b4a0-513a3694efac'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:34 devstack sudo[87457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:34 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Acquiring lock "cinder-b3bc9f5b-ece0-46c1-825f-e7a693549c47-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Lock "cinder-b3bc9f5b-ece0-46c1-825f-e7a693549c47-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Acquiring lock "cinder-quobyte-b3bc9f5b-ece0-46c1-825f-e7a693549c47" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Lock "cinder-quobyte-b3bc9f5b-ece0-46c1-825f-e7a693549c47" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee82b5e6-aaf1-4243-a82c-4e4ed3e8e57b]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:34 devstack sudo[87474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47
Apr 17 05:31:34 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:34 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.590s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:34 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Deleted volume successfully.
Apr 17 05:31:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e2d0a0e-4dc1-40f0-9c42-061f638593ae tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-1843573d-4450-4f32-9326-aa7e500ebfa8-delete_volume" released by "delete_volume" :: held 4.073s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:35 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393" returned: 0 in 1.059s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345__l4w7aizdevstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:31:35 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Converted 112.00 MB image at 105.64 MB/s
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:35 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 1G
Apr 17 05:31:35 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-df7a7d8d-616c-4983-b3cf-b7a56d88daca-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-df7a7d8d-616c-4983-b3cf-b7a56d88daca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "cinder-quobyte-df7a7d8d-616c-4983-b3cf-b7a56d88daca" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-df7a7d8d-616c-4983-b3cf-b7a56d88daca" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d4e194-2fcc-45b9-be5d-58a68f27ea42]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:35 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47" returned: 0 in 0.714s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:35 devstack sudo[87483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47
Apr 17 05:31:35 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:35 devstack sudo[87482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca
Apr 17 05:31:35 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:35 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 1G" returned: 0 in 0.580s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f95bec1-1f8a-4774-9826-ae0c3b3fd0c6]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:35 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393
Apr 17 05:31:35 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:35 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca" returned: 0 in 0.580s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:35 devstack sudo[87495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca
Apr 17 05:31:35 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:35 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b3bc9f5b-ece0-46c1-825f-e7a693549c47" returned: 0 in 0.595s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Lock "cinder-quobyte-b3bc9f5b-ece0-46c1-825f-e7a693549c47" released by "delete_volume" :: held 1.346s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Created reservations ['7d2d6e2e-687a-44c8-955e-7fba56e34b31', '55a7c8b0-e7a0-4c59-a65c-678f652f884a', 'b5041f65-95f9-4f6d-bf47-3965a3b849ee', 'ba64da89-f5c8-4b64-bd35-cfaa5c30a2b9'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:35 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:35 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:36 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393" returned: 0 in 0.549s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:36 devstack sudo[87501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393
Apr 17 05:31:36 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:36 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-df7a7d8d-616c-4983-b3cf-b7a56d88daca" returned: 0 in 0.529s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-quobyte-df7a7d8d-616c-4983-b3cf-b7a56d88daca" released by "delete_volume" :: held 1.143s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Created reservations ['a6787dfd-88a0-4a6a-b9dd-c5edf85c6486', '868c4732-cd42-4a86-bc91-17b2a5d486b1', '55d34bfd-c69b-43b2-aa51-899160f4124f', '8bcbcb2a-ba63-4cff-8450-5295df105c3d'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:36 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.524s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Deleted volume successfully.
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8e26da52-5dc9-40ed-a680-070a6d07dece tempest-VolumeQuotasNegativeTestJSON-982609891 None] Lock "cinder-b3bc9f5b-ece0-46c1-825f-e7a693549c47-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:36 devstack sudo[87505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:36 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:36 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393" returned: 1 in 0.647s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Downloaded image f11dd628-d05d-412e-b4ef-be70c4399345 ((None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}])) to volume c84fa43f-ed82-4e76-adfe-2bc3f883b393 successfully. {{(pid=82266) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Temporary image f11dd628-d05d-412e-b4ef-be70c4399345 for user 5dcafe3a1619474d84a755a00415c91a is deleted. {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Marking volume c84fa43f-ed82-4e76-adfe-2bc3f883b393 as bootable. {{(pid=82266) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Copying metadata from image f11dd628-d05d-412e-b4ef-be70c4399345 to c84fa43f-ed82-4e76-adfe-2bc3f883b393. {{(pid=82266) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Creating volume glance metadata for volume c84fa43f-ed82-4e76-adfe-2bc3f883b393 backed by image f11dd628-d05d-412e-b4ef-be70c4399345 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82266) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a59e29-87e7-43d8-a867-cd5964afb173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536d6752d0>}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa28e97d-5cda-4f1a-94b5-c74c1a1fd6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:36 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Volume volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 (c84fa43f-ed82-4e76-adfe-2bc3f883b393): created successfully
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa28e97d-5cda-4f1a-94b5-c74c1a1fd6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Flow 'volume_create_manager' (1c092674-3c77-4058-a6f0-aa5cee330310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-facd601c-61a3-4805-9b69-a3809b668381 tempest-VolumesExtendTest-373400380 None] Created volume successfully.
Apr 17 05:31:37 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.597s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:37 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:37 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Deleted volume successfully.
Apr 17 05:31:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-494215ff-e28d-4107-9fd9-8401b1cd17a8 tempest-VolumesDeleteCascade-199668281 None] Lock "cinder-df7a7d8d-616c-4983-b3cf-b7a56d88daca-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:37 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d9773f-b43c-4e33-834d-1a1d3a9a222a]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:37 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393
Apr 17 05:31:37 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:38 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393" returned: 0 in 0.658s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:38 devstack sudo[87516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393
Apr 17 05:31:38 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:38 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393" returned: 1 in 0.532s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:31:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 2G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 2G" returned: 0 in 0.056s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.284s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:39 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-713bb3bc-b70e-4372-9c1b-d6011cd6f1d8 tempest-VolumesExtendTest-373400380 None] Extend volume completed successfully.
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Flow 'volume_create_manager' (b311a03f-4837-4ce4-815f-bc0cc5991924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6517acd-84a8-4fc7-b9fd-e116e46bff2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6517acd-84a8-4fc7-b9fd-e116e46bff2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1863247328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77a3dc8-d064-4600-b18a-83bbd5c41ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9593e57c8f47b581159e799aa47dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:40Z,use_quota=True,user_id='97d80d6d7a7f4076b688334fb1283eaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e935cc89-79f1-4ccf-ac2c-fa4bcc9d5022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e935cc89-79f1-4ccf-ac2c-fa4bcc9d5022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcab7de2-9886-43c8-b118-7efa12749613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcab7de2-9886-43c8-b118-7efa12749613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77a3dc8-d064-4600-b18a-83bbd5c41ab5', 'volume_name': 'volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f83d953-26a2-428f-9a17-e5d2368b2486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f83d953-26a2-428f-9a17-e5d2368b2486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ff33bf-d573-4280-86ef-485e1051b2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:39 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Volume e77a3dc8-d064-4600-b18a-83bbd5c41ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5', 'volume_size': 1}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1863247328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77a3dc8-d064-4600-b18a-83bbd5c41ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9593e57c8f47b581159e799aa47dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:40Z,use_quota=True,user_id='97d80d6d7a7f4076b688334fb1283eaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Creating volume e77a3dc8-d064-4600-b18a-83bbd5c41ab5 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:39 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:39 devstack sudo[87524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5 1073741824
Apr 17 05:31:39 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Acquiring lock "cinder-c84fa43f-ed82-4e76-adfe-2bc3f883b393-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Lock "cinder-c84fa43f-ed82-4e76-adfe-2bc3f883b393-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Acquiring lock "cinder-quobyte-c84fa43f-ed82-4e76-adfe-2bc3f883b393" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Lock "cinder-quobyte-c84fa43f-ed82-4e76-adfe-2bc3f883b393" acquired by "delete_volume" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0f3ea4-82d3-4832-ba31-c057bbd1cea7]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:40 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5 1073741824" returned: 0 in 0.559s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:40 devstack sudo[87529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393
Apr 17 05:31:40 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:40 devstack sudo[87531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5
Apr 17 05:31:40 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:40 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393" returned: 0 in 0.586s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:40 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393
Apr 17 05:31:40 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:40 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5" returned: 0 in 0.603s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ff33bf-d573-4280-86ef-485e1051b2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02650d35-15a7-4244-bb94-16d4568eeeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:41 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Volume volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5 (e77a3dc8-d064-4600-b18a-83bbd5c41ab5): created successfully
Apr 17 05:31:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02650d35-15a7-4244-bb94-16d4568eeeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Flow 'volume_create_manager' (b311a03f-4837-4ce4-815f-bc0cc5991924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:41 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7ed0c519-894c-43c7-a263-bc6d9173db01 tempest-VolumesMetadataTest-104600654 None] Created volume successfully.
Apr 17 05:31:41 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393" returned: 1 in 0.590s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:31:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:41 devstack sudo[87541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393
Apr 17 05:31:41 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:42 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c84fa43f-ed82-4e76-adfe-2bc3f883b393" returned: 0 in 0.639s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Lock "cinder-quobyte-c84fa43f-ed82-4e76-adfe-2bc3f883b393" released by "delete_volume" :: held 1.869s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Created reservations ['183b1261-841f-4a1a-aaf6-d07e5775afdf', 'c22c2305-427a-485e-b016-88d52c73df0f', '31d70b29-b442-40f4-b26e-7600131cce07', 'd5ed48a9-5632-4c38-9fcd-af6f9bdb8d1b'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:42 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:42 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Acquiring lock "cinder-e77a3dc8-d064-4600-b18a-83bbd5c41ab5-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Lock "cinder-e77a3dc8-d064-4600-b18a-83bbd5c41ab5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Acquiring lock "cinder-quobyte-e77a3dc8-d064-4600-b18a-83bbd5c41ab5" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Lock "cinder-quobyte-e77a3dc8-d064-4600-b18a-83bbd5c41ab5" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[189c0d1f-22d6-4d1c-83a2-f25fbcb2a2c4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Flow 'volume_create_manager' (b937c4cd-a180-4597-bf68-79453fd3fa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e80de9-bbba-4d1c-86c0-26e222a5d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e80de9-bbba-4d1c-86c0-26e222a5d35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-244989501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb905cf7-7030-4e94-bdc7-ed11b1d538cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f6611cb53144bb9d770cfb8326ad19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:43Z,use_quota=True,user_id='5dcafe3a1619474d84a755a00415c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9fe7c7-f7a7-4262-b0e4-6b2ea0870293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9fe7c7-f7a7-4262-b0e4-6b2ea0870293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36037f54-05e1-40c7-bbe9-1f2ab992801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36037f54-05e1-40c7-bbe9-1f2ab992801e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb905cf7-7030-4e94-bdc7-ed11b1d538cd', 'volume_name': 'volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63191b70-9a72-4be2-94f2-fb99e3404551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63191b70-9a72-4be2-94f2-fb99e3404551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f62bd4-7da9-4cc7-858d-893acc2c795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:42 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Volume fb905cf7-7030-4e94-bdc7-ed11b1d538cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd', 'volume_size': 1}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-244989501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb905cf7-7030-4e94-bdc7-ed11b1d538cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f6611cb53144bb9d770cfb8326ad19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:43Z,use_quota=True,user_id='5dcafe3a1619474d84a755a00415c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Creating volume fb905cf7-7030-4e94-bdc7-ed11b1d538cd {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:42 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:42 devstack sudo[87546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5
Apr 17 05:31:42 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:42 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd 1073741824
Apr 17 05:31:42 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:43 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.770s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:43 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Deleted volume successfully.
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5e5b3f0c-991a-4d0b-bb2a-a1615d324690 tempest-VolumesExtendTest-373400380 None] Lock "cinder-c84fa43f-ed82-4e76-adfe-2bc3f883b393-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Flow 'volume_create_manager' (2c166ac7-e955-4dde-98fb-426cd97e1f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019a8ae6-8fac-4d87-a431-f178d080ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019a8ae6-8fac-4d87-a431-f178d080ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-227036327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c924f777-3efe-49ef-9471-fcff2457d361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e816e5f8f4f437aa4cfdf8a93724d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:43Z,use_quota=True,user_id='9982b23d6a33424b88f35e4ce7e12b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb51314b-b82b-4d72-aea3-f507382ef8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb51314b-b82b-4d72-aea3-f507382ef8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aaad0d9-258a-4508-8bfd-ecdb84579544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aaad0d9-258a-4508-8bfd-ecdb84579544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c924f777-3efe-49ef-9471-fcff2457d361', 'volume_name': 'volume-c924f777-3efe-49ef-9471-fcff2457d361', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ff6f56-7648-436c-a9dc-fc5d9b320cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ff6f56-7648-436c-a9dc-fc5d9b320cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec511db-c028-4e4e-92ff-5b07189b9b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:43 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Volume c924f777-3efe-49ef-9471-fcff2457d361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c924f777-3efe-49ef-9471-fcff2457d361', 'volume_size': 1}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:43 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5" returned: 0 in 0.681s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:43 devstack sudo[87557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5
Apr 17 05:31:43 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:43 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd 1073741824" returned: 0 in 0.639s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:43 devstack sudo[87559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd
Apr 17 05:31:43 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:43 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e77a3dc8-d064-4600-b18a-83bbd5c41ab5" returned: 0 in 0.423s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Lock "cinder-quobyte-e77a3dc8-d064-4600-b18a-83bbd5c41ab5" released by "delete_volume" :: held 1.126s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Created reservations ['606a19ee-ae0d-4f1f-9245-9aa92aff6ac2', 'e84f806b-1e75-4ea6-b69a-db1927c7d332', '7d19596b-d911-4864-b811-9dd4cd5ee15a', '55cee128-c474-4742-b940-a6dd7a506a8d'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:43 devstack sudo[87563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:43 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:43 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" returned: 0 in 0.482s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-227036327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c924f777-3efe-49ef-9471-fcff2457d361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e816e5f8f4f437aa4cfdf8a93724d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:43Z,use_quota=True,user_id='9982b23d6a33424b88f35e4ce7e12b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Creating volume c924f777-3efe-49ef-9471-fcff2457d361 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:43 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:44 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f62bd4-7da9-4cc7-858d-893acc2c795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:44 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5639c9-fe60-4fec-95b2-f3ba9872ce59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:44 devstack sudo[87565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361 1073741824
Apr 17 05:31:44 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:44 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Volume volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd (fb905cf7-7030-4e94-bdc7-ed11b1d538cd): created successfully
Apr 17 05:31:44 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5639c9-fe60-4fec-95b2-f3ba9872ce59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:44 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Flow 'volume_create_manager' (b937c4cd-a180-4597-bf68-79453fd3fa26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:44 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-38e10d4c-f380-40d1-add8-2ce6019c8f5c tempest-VolumesExtendTest-373400380 None] Created volume successfully.
Apr 17 05:31:44 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:44 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:44 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Deleted volume successfully.
Apr 17 05:31:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-371930ab-8efb-417e-9229-028a6486e316 tempest-VolumesMetadataTest-104600654 None] Lock "cinder-e77a3dc8-d064-4600-b18a-83bbd5c41ab5-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:44 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361 1073741824" returned: 0 in 0.590s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:44 devstack sudo[87571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361
Apr 17 05:31:44 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:45 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361" returned: 0 in 0.564s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.190s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec511db-c028-4e4e-92ff-5b07189b9b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c924f777-3efe-49ef-9471-fcff2457d361', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990b4be7-8de4-420b-bc0b-19920da52644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Creating offline snapshot 33f676c6-eafe-459c-a32b-7c576f7ed743 of volume fb905cf7-7030-4e94-bdc7-ed11b1d538cd {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:31:45 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Volume volume-c924f777-3efe-49ef-9471-fcff2457d361 (c924f777-3efe-49ef-9471-fcff2457d361): created successfully
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990b4be7-8de4-420b-bc0b-19920da52644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Flow 'volume_create_manager' (2c166ac7-e955-4dde-98fb-426cd97e1f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[469140de-7c08-4246-b555-21ecffb1e07e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:45 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-94610cc3-2b10-4416-8ee9-c1a14638f6b9 tempest-SnapshotMetadataTestJSON-1953546852 None] Created volume successfully.
Apr 17 05:31:45 devstack sudo[87574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd
Apr 17 05:31:45 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:45 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" returned: 0 in 0.762s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:46 devstack sudo[87581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 1G
Apr 17 05:31:46 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:46 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 1G" returned: 0 in 0.557s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:46 devstack sudo[87592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743
Apr 17 05:31:46 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:47 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743" returned: 0 in 0.516s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:47 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 is being set with open permissions: ugo+rw
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:47 devstack sudo[87598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743
Apr 17 05:31:47 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:47 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743" returned: 0 in 0.468s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:47 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.info
Apr 17 05:31:47 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Flow 'volume_create_manager' (63b4ae5b-2321-4f40-8f9f-161ac9a850cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed38784-d674-4925-88ef-72cfa2f426a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed38784-d674-4925-88ef-72cfa2f426a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1100517889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7d8cc1-161a-43b4-87a2-aee235f86b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b61115e92f4f80bdcdf3e3c2e6184b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:48Z,use_quota=True,user_id='cfb7374654904f9fb4d11767bd10bbe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f89387e-bf55-4a43-a07f-cf071fd08a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f89387e-bf55-4a43-a07f-cf071fd08a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f41ed84a-8be3-4a5b-855e-6162e22c447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f41ed84a-8be3-4a5b-855e-6162e22c447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7d8cc1-161a-43b4-87a2-aee235f86b9d', 'volume_name': 'volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59949ad-3271-42af-883a-9e935ed3ccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:47 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59949ad-3271-42af-883a-9e935ed3ccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc5aced-0d58-42fd-ab32-44885335e94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:48 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Volume 8b7d8cc1-161a-43b4-87a2-aee235f86b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d', 'volume_size': 1}
Apr 17 05:31:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:48 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.info" returned: 0 in 0.494s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:48 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.info is being set with open permissions: ugo+rw
Apr 17 05:31:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:48 devstack sudo[87604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.info
Apr 17 05:31:48 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:48 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.info" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.349s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.960s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Creating offline snapshot 88fe46de-371a-43ec-b069-2a10f847a9c3 of volume c924f777-3efe-49ef-9471-fcff2457d361 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:31:48 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc141520-8bb5-4609-8f32-bdcaade74c54]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:48 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-631b4901-1c5e-4a43-bfc2-315368567171 tempest-VolumesExtendTest-373400380 None] Create snapshot completed successfully
Apr 17 05:31:48 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361
Apr 17 05:31:48 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:49 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361" returned: 0 in 0.511s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:49 devstack sudo[87612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3 1G
Apr 17 05:31:49 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-16c788fb-6e4a-43b1-ace3-d1297d7aa4b6 tempest-VolumesExtendTest-373400380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:49 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3 1G" returned: 0 in 0.555s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c924f777-3efe-49ef-9471-fcff2457d361 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:49 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c924f777-3efe-49ef-9471-fcff2457d361 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3
Apr 17 05:31:49 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:50 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c924f777-3efe-49ef-9471-fcff2457d361 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3" returned: 0 in 0.479s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:50 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3 is being set with open permissions: ugo+rw
Apr 17 05:31:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:50 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3
Apr 17 05:31:50 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:50 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3" returned: 0 in 0.447s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:50 devstack sudo[87625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.info
Apr 17 05:31:50 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:51 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.info" returned: 0 in 0.445s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:51 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.info is being set with open permissions: ugo+rw
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:51 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.info
Apr 17 05:31:51 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:51 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.info" returned: 0 in 0.432s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.935s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.465s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1100517889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7d8cc1-161a-43b4-87a2-aee235f86b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b61115e92f4f80bdcdf3e3c2e6184b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:48Z,use_quota=True,user_id='cfb7374654904f9fb4d11767bd10bbe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Creating volume 8b7d8cc1-161a-43b4-87a2-aee235f86b9d {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:51 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:51 devstack sudo[87631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d 1073741824
Apr 17 05:31:51 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:51 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7d4847ba-ea22-4b95-afa7-f4664e2a23da tempest-SnapshotMetadataTestJSON-1953546852 None] Create snapshot completed successfully
Apr 17 05:31:52 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d 1073741824" returned: 0 in 0.580s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:52 devstack sudo[87636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d
Apr 17 05:31:52 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Acquiring lock "cinder-88fe46de-371a-43ec-b069-2a10f847a9c3-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "cinder-88fe46de-371a-43ec-b069-2a10f847a9c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Acquiring lock "cinder-quobyte-c924f777-3efe-49ef-9471-fcff2457d361" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "cinder-quobyte-c924f777-3efe-49ef-9471-fcff2457d361" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Acquiring lock "cinder-quobyte-88fe46de-371a-43ec-b069-2a10f847a9c3" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "cinder-quobyte-88fe46de-371a-43ec-b069-2a10f847a9c3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Deleting offline snapshot 88fe46de-371a-43ec-b069-2a10f847a9c3 of volume c924f777-3efe-49ef-9471-fcff2457d361 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] snapshot_file for this snap is: volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b390edf8-43e1-4b87-a2a9-d889b0c6d710]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:52 devstack sudo[87638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3
Apr 17 05:31:52 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:52 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d" returned: 0 in 0.501s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-16c788fb-6e4a-43b1-ace3-d1297d7aa4b6 tempest-VolumesExtendTest-373400380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.357s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46d4d4a-3a86-4eae-8411-8840fe9b0e3f]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-16c788fb-6e4a-43b1-ace3-d1297d7aa4b6 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc5aced-0d58-42fd-ab32-44885335e94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b25e795-95ae-4b91-bcea-0da34ad054c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:52 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Volume volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d (8b7d8cc1-161a-43b4-87a2-aee235f86b9d): created successfully
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b25e795-95ae-4b91-bcea-0da34ad054c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Flow 'volume_create_manager' (63b4ae5b-2321-4f40-8f9f-161ac9a850cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:52 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-02d00ef7-9220-4f7b-a524-2efc866d2e31 tempest-VolumesTransfersV355Test-1290167399 None] Created volume successfully.
Apr 17 05:31:52 devstack sudo[87641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd
Apr 17 05:31:52 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_service.periodic_task [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:52 devstack sudo[87645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:52 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:52 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3" returned: 0 in 0.525s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c924f777-3efe-49ef-9471-fcff2457d361(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1354388a-1829-428c-a8d6-f94e3dcca0b8]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:53 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361
Apr 17 05:31:53 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:53 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-16c788fb-6e4a-43b1-ace3-d1297d7aa4b6 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" returned: 0 in 0.521s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-16c788fb-6e4a-43b1-ace3-d1297d7aa4b6 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 2G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-16c788fb-6e4a-43b1-ace3-d1297d7aa4b6 tempest-VolumesExtendTest-373400380 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 2G" returned: 0 in 0.097s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-16c788fb-6e4a-43b1-ace3-d1297d7aa4b6 tempest-VolumesExtendTest-373400380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.635s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:53 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-16c788fb-6e4a-43b1-ace3-d1297d7aa4b6 tempest-VolumesExtendTest-373400380 None] Extend volume completed successfully.
Apr 17 05:31:53 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.563s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Acquiring lock "cinder-33f676c6-eafe-459c-a32b-7c576f7ed743-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:53 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361" returned: 0 in 0.664s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Lock "cinder-33f676c6-eafe-459c-a32b-7c576f7ed743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Acquiring lock "cinder-quobyte-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Lock "cinder-quobyte-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Acquiring lock "cinder-quobyte-33f676c6-eafe-459c-a32b-7c576f7ed743" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:53 devstack sudo[87660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3
Apr 17 05:31:53 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Lock "cinder-quobyte-33f676c6-eafe-459c-a32b-7c576f7ed743" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Deleting offline snapshot 33f676c6-eafe-459c-a32b-7c576f7ed743 of volume fb905cf7-7030-4e94-bdc7-ed11b1d538cd {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] snapshot_file for this snap is: volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3413ccb-2361-4b2e-a8e5-ca6461367da4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:53 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-28b159d3-f82e-4603-8f23-3c9e206d5d72 tempest-VolumesTransfersV355Test-1501543402 None] Transfer volume completed successfully.
Apr 17 05:31:53 devstack sudo[87662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743
Apr 17 05:31:53 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:54 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3" returned: 0 in 0.578s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:54 devstack sudo[87670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3
Apr 17 05:31:54 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:54 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743" returned: 0 in 0.612s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5945d4-dbaa-457c-88d2-f49d36f2d6b9]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:54 devstack sudo[87672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd
Apr 17 05:31:54 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Acquiring lock "cinder-8b7d8cc1-161a-43b4-87a2-aee235f86b9d-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Lock "cinder-8b7d8cc1-161a-43b4-87a2-aee235f86b9d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Acquiring lock "cinder-quobyte-8b7d8cc1-161a-43b4-87a2-aee235f86b9d" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Lock "cinder-quobyte-8b7d8cc1-161a-43b4-87a2-aee235f86b9d" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:54 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361.88fe46de-371a-43ec-b069-2a10f847a9c3" returned: 0 in 0.488s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0221989a-f3ff-481e-81d6-645f63cccf2e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "cinder-quobyte-88fe46de-371a-43ec-b069-2a10f847a9c3" released by "_delete_snapshot" :: held 2.338s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "cinder-quobyte-c924f777-3efe-49ef-9471-fcff2457d361" released by "delete_snapshot" :: held 2.350s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Created reservations ['cb2958b3-6979-4f05-a4c2-c8c38194be81', '9c482084-7a73-4c45-aea8-475ddda2830c', '17487148-0c35-482e-a985-2dad200daaa8', 'f2e4af01-60a4-4c0a-8f39-c7ada9fdf699'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:54 devstack sudo[87675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d
Apr 17 05:31:54 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:54 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Delete snapshot completed successfully.
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8d803e05-8629-4d06-9f9b-db61f714d2ca tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "cinder-88fe46de-371a-43ec-b069-2a10f847a9c3-delete_snapshot" released by "delete_snapshot" :: held 2.432s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:54 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" returned: 0 in 0.623s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:54 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743
Apr 17 05:31:54 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:55 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d" returned: 0 in 0.584s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:55 devstack sudo[87685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d
Apr 17 05:31:55 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:55 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743" returned: 0 in 0.518s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:55 devstack sudo[87690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743
Apr 17 05:31:55 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Acquiring lock "cinder-c924f777-3efe-49ef-9471-fcff2457d361-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "cinder-c924f777-3efe-49ef-9471-fcff2457d361-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Acquiring lock "cinder-quobyte-c924f777-3efe-49ef-9471-fcff2457d361" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "cinder-quobyte-c924f777-3efe-49ef-9471-fcff2457d361" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0425333d-d200-4534-9514-88a144007c5f]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:55 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361
Apr 17 05:31:55 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:55 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8b7d8cc1-161a-43b4-87a2-aee235f86b9d" returned: 0 in 0.563s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Lock "cinder-quobyte-8b7d8cc1-161a-43b4-87a2-aee235f86b9d" released by "delete_volume" :: held 1.172s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Created reservations ['9245d87b-d655-4f9d-a4c4-e7499ad1d418', '65a5f3d0-172d-4d6b-a26e-23764ba67286', 'f9350ef1-31c7-4672-9987-9920e3015a3d', '858bfad5-0427-410b-9a67-e3e653e383fb'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:55 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd.33f676c6-eafe-459c-a32b-7c576f7ed743" returned: 0 in 0.482s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Lock "cinder-quobyte-33f676c6-eafe-459c-a32b-7c576f7ed743" released by "_delete_snapshot" :: held 2.298s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Lock "cinder-quobyte-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" released by "delete_snapshot" :: held 2.312s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:56 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:56 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Created reservations ['be7b3ab0-4892-48fe-9978-97a0eb481ebf', '12bccbfe-0485-4709-9aeb-eabe4b4a2435', 'b3f8b1cf-5395-4010-9355-4bd5071b1d3e', 'b3c70af2-17c5-45b4-8421-26f086f2e294'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:56 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Delete snapshot completed successfully.
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9aac8302-76b9-4f35-b2c2-18c2549e87c9 tempest-VolumesExtendTest-373400380 None] Lock "cinder-33f676c6-eafe-459c-a32b-7c576f7ed743-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:56 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361" returned: 0 in 0.569s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:56 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361
Apr 17 05:31:56 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:56 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.465s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:56 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Deleted volume successfully.
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd032246-8035-4066-8572-2328b3035b2f tempest-VolumesTransfersV355Test-563238932 None] Lock "cinder-8b7d8cc1-161a-43b4-87a2-aee235f86b9d-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:56 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c924f777-3efe-49ef-9471-fcff2457d361" returned: 0 in 0.560s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "cinder-quobyte-c924f777-3efe-49ef-9471-fcff2457d361" released by "delete_volume" :: held 1.173s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Acquiring lock "cinder-fb905cf7-7030-4e94-bdc7-ed11b1d538cd-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Created reservations ['4a8cd7e6-5517-4f42-9865-8c355847db53', '475c2e52-db1b-43a8-a198-8fd32a475a7a', '27ad5ace-9179-4507-bc51-9a04be28f14c', 'b0ae4858-0ac4-4efa-9134-0249296178b1'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Lock "cinder-fb905cf7-7030-4e94-bdc7-ed11b1d538cd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:56 devstack sudo[87705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:56 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Acquiring lock "cinder-quobyte-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Lock "cinder-quobyte-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:56 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb74be3-c806-4b75-b640-46efd948de20]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:57 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd
Apr 17 05:31:57 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Flow 'volume_create_manager' (50154c7f-9c39-4a90-9cea-4046daed5239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da53f3c2-d1bb-4b7b-8886-3c39e0b929df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da53f3c2-d1bb-4b7b-8886-3c39e0b929df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1803583144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfb852b-c392-448c-8279-d2192d1659ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b61115e92f4f80bdcdf3e3c2e6184b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:57Z,use_quota=True,user_id='cfb7374654904f9fb4d11767bd10bbe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5287f3c7-1b82-4176-b3fb-4b7a814fa846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5287f3c7-1b82-4176-b3fb-4b7a814fa846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7205f40b-c08f-4917-8f3a-778771ec6105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7205f40b-c08f-4917-8f3a-778771ec6105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acfb852b-c392-448c-8279-d2192d1659ad', 'volume_name': 'volume-acfb852b-c392-448c-8279-d2192d1659ad', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4b68bf-ccff-4ca2-9b61-d0cd61fc405f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4b68bf-ccff-4ca2-9b61-d0cd61fc405f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f87e455-e256-496c-906f-c7e30ca37a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:57 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Volume acfb852b-c392-448c-8279-d2192d1659ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acfb852b-c392-448c-8279-d2192d1659ad', 'volume_size': 1}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1803583144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfb852b-c392-448c-8279-d2192d1659ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b61115e92f4f80bdcdf3e3c2e6184b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:31:57Z,use_quota=True,user_id='cfb7374654904f9fb4d11767bd10bbe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Creating volume acfb852b-c392-448c-8279-d2192d1659ad {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:31:57 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:57 devstack sudo[87710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad 1073741824
Apr 17 05:31:57 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:57 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.559s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:57 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Deleted volume successfully.
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b0a34931-b48e-4439-b07a-ed0561647446 tempest-SnapshotMetadataTestJSON-1953546852 None] Lock "cinder-c924f777-3efe-49ef-9471-fcff2457d361-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:57 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" returned: 0 in 0.600s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:57 devstack sudo[87716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd
Apr 17 05:31:57 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:57 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad 1073741824" returned: 0 in 0.594s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:57 devstack sudo[87721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad
Apr 17 05:31:57 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:58 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" returned: 0 in 0.547s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Lock "cinder-quobyte-fb905cf7-7030-4e94-bdc7-ed11b1d538cd" released by "delete_volume" :: held 1.183s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Created reservations ['1f06f34b-0849-4e26-9123-d1567d2f6c41', 'c4aa3be1-4585-4fd0-a906-173d348928dc', '4a92d4f9-ee32-4cf4-839d-f35b9aa927bc', '4a8bbc9d-90bc-499a-b294-e0a32bd29307'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:58 devstack sudo[87724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:31:58 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:58 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad" returned: 0 in 0.564s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f87e455-e256-496c-906f-c7e30ca37a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acfb852b-c392-448c-8279-d2192d1659ad', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eceb1b62-1dda-4815-b8ea-5602422eb48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:31:58 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Volume volume-acfb852b-c392-448c-8279-d2192d1659ad (acfb852b-c392-448c-8279-d2192d1659ad): created successfully
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eceb1b62-1dda-4815-b8ea-5602422eb48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Flow 'volume_create_manager' (50154c7f-9c39-4a90-9cea-4046daed5239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4f9a4e3a-6b1a-4e04-b5ae-0d06bfd84285 tempest-VolumesTransfersV355Test-1290167399 None] Created volume successfully.
Apr 17 05:31:58 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.665s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:31:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Deleted volume successfully.
Apr 17 05:31:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-afd21393-d831-4f5b-935a-a98cbfc5b3de tempest-VolumesExtendTest-373400380 None] Lock "cinder-fb905cf7-7030-4e94-bdc7-ed11b1d538cd-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Acquiring lock "cinder-acfb852b-c392-448c-8279-d2192d1659ad-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Lock "cinder-acfb852b-c392-448c-8279-d2192d1659ad-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Acquiring lock "cinder-quobyte-acfb852b-c392-448c-8279-d2192d1659ad" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Lock "cinder-quobyte-acfb852b-c392-448c-8279-d2192d1659ad" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0226838-91a9-46a2-8c10-a7fd3e402036]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:31:59 devstack sudo[87728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad
Apr 17 05:31:59 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=161,cinder:DELETE=19,cinder:UPDATE=176,cinder:INSERT=57 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:UPDATE=232,cinder:SELECT=174,cinder:INSERT=57,cinder:DELETE=14 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Flow 'volume_create_manager' (a142dbd3-1d49-4bb5-9ad6-94ffe039afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:31:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de90fe8c-f3fe-4691-9e7c-940480afc5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de90fe8c-f3fe-4691-9e7c-940480afc5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-876481759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726c49aa-b1c6-42f5-bd55-7fa115c92a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c8cdfa1f0f42bab462d60fb17f6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:00Z,use_quota=True,user_id='f2dcab5e08084f86adbce799f7ec33e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7afdcc-7a3f-4ffc-b8cb-079247204603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7afdcc-7a3f-4ffc-b8cb-079247204603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532fe1e6-4cda-468a-b620-ff274c2d48f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532fe1e6-4cda-468a-b620-ff274c2d48f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726c49aa-b1c6-42f5-bd55-7fa115c92a0c', 'volume_name': 'volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f9c9ab-272d-4e7e-98c8-638c6e68c53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f9c9ab-272d-4e7e-98c8-638c6e68c53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648e648a-49a6-4e3c-8a1c-29c25b1e288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:00 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Volume 726c49aa-b1c6-42f5-bd55-7fa115c92a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c', 'volume_size': 1}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-876481759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726c49aa-b1c6-42f5-bd55-7fa115c92a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c8cdfa1f0f42bab462d60fb17f6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:00Z,use_quota=True,user_id='f2dcab5e08084f86adbce799f7ec33e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Creating volume 726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:00 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:00 devstack sudo[87730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c 1073741824
Apr 17 05:32:00 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:00 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad" returned: 0 in 0.748s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:00 devstack sudo[87735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad
Apr 17 05:32:00 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:00 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c 1073741824" returned: 0 in 0.755s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:00 devstack sudo[87740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c
Apr 17 05:32:00 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:01 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-acfb852b-c392-448c-8279-d2192d1659ad" returned: 0 in 0.600s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Lock "cinder-quobyte-acfb852b-c392-448c-8279-d2192d1659ad" released by "delete_volume" :: held 1.378s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Created reservations ['cb627378-2013-4a00-804b-2501ce55fb9e', '6b3d63a0-dee3-471b-b367-8219fb380a33', '300df7d8-f38b-405b-939a-5ceb55ee31e9', '44639685-0285-4d64-b41f-7b57da4c51eb'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:01 devstack sudo[87743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:01 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:01 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c" returned: 0 in 0.539s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648e648a-49a6-4e3c-8a1c-29c25b1e288f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490c2790-fe7b-426c-9155-91e61fd2368c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:01 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Volume volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c (726c49aa-b1c6-42f5-bd55-7fa115c92a0c): created successfully
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490c2790-fe7b-426c-9155-91e61fd2368c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Flow 'volume_create_manager' (a142dbd3-1d49-4bb5-9ad6-94ffe039afc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:01 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1ceee3c2-f546-4ab0-bb11-d52bae4c15f7 tempest-VolumesCloneTest-1403171735 None] Created volume successfully.
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Flow 'volume_create_manager' (65c0bacd-b737-47a7-9934-2d465c51411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b361401d-5bf5-44a8-8a49-4ddabb38db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b361401d-5bf5-44a8-8a49-4ddabb38db32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938152806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d80889de504155b7c60a706de64d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:02Z,use_quota=True,user_id='6f72181693294b6aa464abee1f9b7bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9715b50a-25b7-4d68-ba82-fc6862cea3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9715b50a-25b7-4d68-ba82-fc6862cea3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0a26f5-2396-4539-b928-c4d01f8d5b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0a26f5-2396-4539-b928-c4d01f8d5b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c', 'volume_name': 'volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d7c428-0b64-4a67-a007-026f7e012be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d7c428-0b64-4a67-a007-026f7e012be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c664fe9c-e35f-492d-bffb-d0d828dfa3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:01 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Volume 71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c', 'volume_size': 1}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938152806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d80889de504155b7c60a706de64d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:02Z,use_quota=True,user_id='6f72181693294b6aa464abee1f9b7bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Creating volume 71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:01 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:01 devstack sudo[87747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c 1073741824
Apr 17 05:32:01 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Flow 'volume_create_manager' (fa9c0ed6-c51b-495c-9a0c-8df6a56d77f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c25e8b2-0614-46bc-9894-6c648e4d3a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:01 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.790s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:01 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Deleted volume successfully.
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c25e8b2-0614-46bc-9894-6c648e4d3a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1283088693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e2e8e7-eb31-49a6-a276-206747f6d7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d80889de504155b7c60a706de64d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:02Z,use_quota=True,user_id='6f72181693294b6aa464abee1f9b7bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea477de-d112-40c7-812d-e0747fd02774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea477de-d112-40c7-812d-e0747fd02774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0fbf55-e4ff-4c49-a6d4-499f5fac7ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0fbf55-e4ff-4c49-a6d4-499f5fac7ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e2e8e7-eb31-49a6-a276-206747f6d7f4', 'volume_name': 'volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2a15d9-f1df-47e0-a4a4-e7d0effa0567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2a15d9-f1df-47e0-a4a4-e7d0effa0567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c75782-5600-4e8b-87ce-2de5c2a9c12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Volume 42e2e8e7-eb31-49a6-a276-206747f6d7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4', 'volume_size': 1}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-51160b2e-454a-447a-8651-076d43918689 tempest-VolumesTransfersV355Test-563238932 None] Lock "cinder-acfb852b-c392-448c-8279-d2192d1659ad-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Flow 'volume_create_manager' (49db72e6-0a71-45c6-b0c8-7d9cee6c7f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae819ef-ce92-42a3-a02d-3eb3c0312955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae819ef-ce92-42a3-a02d-3eb3c0312955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-969006063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac921b5-c973-48d8-a53a-99d4d2a62781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d80889de504155b7c60a706de64d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:02Z,use_quota=True,user_id='6f72181693294b6aa464abee1f9b7bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39d2499-c709-41ab-98be-ed4a8e4b96cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39d2499-c709-41ab-98be-ed4a8e4b96cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d31372-17d6-4b1b-8eb9-0bc1007422bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d31372-17d6-4b1b-8eb9-0bc1007422bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac921b5-c973-48d8-a53a-99d4d2a62781', 'volume_name': 'volume-eac921b5-c973-48d8-a53a-99d4d2a62781', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa8ab216-4b71-4afc-a258-c9f318b9e200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa8ab216-4b71-4afc-a258-c9f318b9e200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff58d20-0854-4772-8e31-a7bde04c289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Volume eac921b5-c973-48d8-a53a-99d4d2a62781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac921b5-c973-48d8-a53a-99d4d2a62781', 'volume_size': 1}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Flow 'volume_create_manager' (1ac0b3e8-fc95-4a98-bed5-86a922c465db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3f2612-7e99-4d39-a17b-25c9060b31d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3f2612-7e99-4d39-a17b-25c9060b31d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1150607111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2274dd76-125e-4210-a040-cafa47d13ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d80889de504155b7c60a706de64d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:02Z,use_quota=True,user_id='6f72181693294b6aa464abee1f9b7bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77102f7f-5ec5-4aba-a958-1a26bcb7ed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77102f7f-5ec5-4aba-a958-1a26bcb7ed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b00fdd3-32db-48f4-bb2f-737d4ebcbaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b00fdd3-32db-48f4-bb2f-737d4ebcbaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2274dd76-125e-4210-a040-cafa47d13ac1', 'volume_name': 'volume-2274dd76-125e-4210-a040-cafa47d13ac1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fd2ffe-e604-43c1-a0c5-6cfba9411c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fd2ffe-e604-43c1-a0c5-6cfba9411c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384182bf-c68a-41bf-a460-0c0e49695449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Volume 2274dd76-125e-4210-a040-cafa47d13ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2274dd76-125e-4210-a040-cafa47d13ac1', 'volume_size': 1}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:02 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c 1073741824" returned: 0 in 0.911s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Flow 'volume_create_manager' (bf1c0fc8-a95c-4241-9060-2a4f6af1cab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb475ec-13c5-4e9c-a75c-49b84fecf3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Flow 'volume_create_manager' (7e52baa7-5960-4c11-86c5-cb7e6de295c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbe1548-025a-4949-80ac-403b5bfcd81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb475ec-13c5-4e9c-a75c-49b84fecf3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1675500706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d276da1-0bc3-435a-bc77-950be6acb43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c8cdfa1f0f42bab462d60fb17f6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=726c49aa-b1c6-42f5-bd55-7fa115c92a0c,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:03Z,use_quota=True,user_id='f2dcab5e08084f86adbce799f7ec33e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82301fb-1e46-44e4-ae0e-1e5859ef9758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82301fb-1e46-44e4-ae0e-1e5859ef9758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e771d39-df06-431e-b7a7-6179487a2a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbe1548-025a-4949-80ac-403b5bfcd81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-93669440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805a11b0-c974-4712-8b05-3872d57a5501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d80889de504155b7c60a706de64d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:03Z,use_quota=True,user_id='6f72181693294b6aa464abee1f9b7bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4644e49-4f4d-4dd0-ae23-be544af75bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4644e49-4f4d-4dd0-ae23-be544af75bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31575ca7-f003-4dd7-a5de-16433770ddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31575ca7-f003-4dd7-a5de-16433770ddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805a11b0-c974-4712-8b05-3872d57a5501', 'volume_name': 'volume-805a11b0-c974-4712-8b05-3872d57a5501', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec13356c-f471-4218-a602-3c4e45c880de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec13356c-f471-4218-a602-3c4e45c880de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806b2b0e-e427-4151-aafa-539ae1655f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Volume 805a11b0-c974-4712-8b05-3872d57a5501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805a11b0-c974-4712-8b05-3872d57a5501', 'volume_size': 1}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e771d39-df06-431e-b7a7-6179487a2a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2d276da1-0bc3-435a-bc77-950be6acb43b', 'volume_name': 'volume-2d276da1-0bc3-435a-bc77-950be6acb43b', 'volume_size': 2, 'source_volid': '726c49aa-b1c6-42f5-bd55-7fa115c92a0c', 'source_volstatus': 'available'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fae7707-11c4-4b18-a221-fe562938a4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fae7707-11c4-4b18-a221-fe562938a4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f52ff6f-f62f-4588-94bc-5b59ae3a2b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:02 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Volume 2d276da1-0bc3-435a-bc77-950be6acb43b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2d276da1-0bc3-435a-bc77-950be6acb43b', 'volume_size': 2, 'source_volid': '726c49aa-b1c6-42f5-bd55-7fa115c92a0c', 'source_volstatus': 'available'}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:02 devstack sudo[87754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c
Apr 17 05:32:02 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:03 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c" returned: 0 in 0.595s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1283088693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e2e8e7-eb31-49a6-a276-206747f6d7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d80889de504155b7c60a706de64d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:02Z,use_quota=True,user_id='6f72181693294b6aa464abee1f9b7bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Creating volume 42e2e8e7-eb31-49a6-a276-206747f6d7f4 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:03 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c664fe9c-e35f-492d-bffb-d0d828dfa3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:03 devstack sudo[87789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4 1073741824
Apr 17 05:32:03 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bd73b0-3a1a-4e7a-aebf-f734f7110a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:03 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Volume volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c (71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c): created successfully
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bd73b0-3a1a-4e7a-aebf-f734f7110a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Flow 'volume_create_manager' (65c0bacd-b737-47a7-9934-2d465c51411f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:03 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ae28a724-ee14-4a63-ac21-d91e0b5f3b5f tempest-CreateVolumesFromImageTest-525062696 None] Created volume successfully.
Apr 17 05:32:04 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4 1073741824" returned: 0 in 0.709s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:04 devstack sudo[87796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4
Apr 17 05:32:04 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:04 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4" returned: 0 in 0.637s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.453s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-969006063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac921b5-c973-48d8-a53a-99d4d2a62781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d80889de504155b7c60a706de64d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:02Z,use_quota=True,user_id='6f72181693294b6aa464abee1f9b7bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Creating volume eac921b5-c973-48d8-a53a-99d4d2a62781 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:04 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c75782-5600-4e8b-87ce-2de5c2a9c12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:04 devstack sudo[87800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781 1073741824
Apr 17 05:32:04 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c3a858-72d1-4734-9297-9170099b2a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:04 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Volume volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4 (42e2e8e7-eb31-49a6-a276-206747f6d7f4): created successfully
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c3a858-72d1-4734-9297-9170099b2a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Flow 'volume_create_manager' (fa9c0ed6-c51b-495c-9a0c-8df6a56d77f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:04 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f035e007-bcf8-46b4-bcf5-3ce4acfbbee2 tempest-CreateVolumesFromImageTest-525062696 None] Created volume successfully.
Apr 17 05:32:05 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781 1073741824" returned: 0 in 0.658s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:05 devstack sudo[87805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781
Apr 17 05:32:05 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:06 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781" returned: 0 in 0.592s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.587s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1150607111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2274dd76-125e-4210-a040-cafa47d13ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d80889de504155b7c60a706de64d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:02Z,use_quota=True,user_id='6f72181693294b6aa464abee1f9b7bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Creating volume 2274dd76-125e-4210-a040-cafa47d13ac1 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:06 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff58d20-0854-4772-8e31-a7bde04c289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac921b5-c973-48d8-a53a-99d4d2a62781', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:06 devstack sudo[87808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1 1073741824
Apr 17 05:32:06 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03bfb29-ba1b-4ca7-a1bf-c53b09070a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:06 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Volume volume-eac921b5-c973-48d8-a53a-99d4d2a62781 (eac921b5-c973-48d8-a53a-99d4d2a62781): created successfully
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03bfb29-ba1b-4ca7-a1bf-c53b09070a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Flow 'volume_create_manager' (49db72e6-0a71-45c6-b0c8-7d9cee6c7f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8ec6520b-f0fc-4e5a-a45f-e8a402241f66 tempest-CreateVolumesFromImageTest-525062696 None] Created volume successfully.
Apr 17 05:32:06 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1 1073741824" returned: 0 in 0.586s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:06 devstack sudo[87813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1
Apr 17 05:32:06 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:07 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1" returned: 0 in 0.529s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.483s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-93669440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805a11b0-c974-4712-8b05-3872d57a5501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d80889de504155b7c60a706de64d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:03Z,use_quota=True,user_id='6f72181693294b6aa464abee1f9b7bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Creating volume 805a11b0-c974-4712-8b05-3872d57a5501 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:07 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384182bf-c68a-41bf-a460-0c0e49695449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2274dd76-125e-4210-a040-cafa47d13ac1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577dd00c-b029-43d2-8397-ca6a4b92c902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:07 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Volume volume-2274dd76-125e-4210-a040-cafa47d13ac1 (2274dd76-125e-4210-a040-cafa47d13ac1): created successfully
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577dd00c-b029-43d2-8397-ca6a4b92c902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Flow 'volume_create_manager' (1ac0b3e8-fc95-4a98-bed5-86a922c465db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:07 devstack sudo[87817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501 1073741824
Apr 17 05:32:07 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:07 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-b8bb0389-6d3c-450b-a71a-2fbfe929f059 tempest-CreateVolumesFromImageTest-525062696 None] Created volume successfully.
Apr 17 05:32:08 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501 1073741824" returned: 0 in 0.820s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:08 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501
Apr 17 05:32:08 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Flow 'volume_create_manager' (f54fcacb-c24c-4a65-837a-d9761261f7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddeff66d-7945-447f-a9cc-cd367ec965e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddeff66d-7945-447f-a9cc-cd367ec965e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1728648548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cdd00f-e448-4ae8-8da4-75aed3da39c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79546f194b345c88e8664a4613b7fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:08Z,use_quota=True,user_id='8c9d83ea6001461a9fdeab1f07c92dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da10982-c88f-41ed-9407-f301e63fc531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da10982-c88f-41ed-9407-f301e63fc531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1257d8-abc9-4883-a5ce-145404188251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1257d8-abc9-4883-a5ce-145404188251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69cdd00f-e448-4ae8-8da4-75aed3da39c7', 'volume_name': 'volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207d79b6-3038-44d3-bc19-2c438c881e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207d79b6-3038-44d3-bc19-2c438c881e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a75e185-6645-49ea-b3e3-b1946d7b0777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:08 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Volume 69cdd00f-e448-4ae8-8da4-75aed3da39c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7', 'volume_size': 1}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:08 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501" returned: 0 in 0.578s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.871s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:08 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Cloning volume 726c49aa-b1c6-42f5-bd55-7fa115c92a0c to volume 2d276da1-0bc3-435a-bc77-950be6acb43b
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806b2b0e-e427-4151-aafa-539ae1655f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805a11b0-c974-4712-8b05-3872d57a5501', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f1df5a-7cd9-438a-a912-da42184c5ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:08 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Volume volume-805a11b0-c974-4712-8b05-3872d57a5501 (805a11b0-c974-4712-8b05-3872d57a5501): created successfully
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f1df5a-7cd9-438a-a912-da42184c5ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Flow 'volume_create_manager' (7e52baa7-5960-4c11-86c5-cb7e6de295c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:08 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-89ae477b-b4dc-4e4c-bb96-235cebd31ecd tempest-CreateVolumesFromImageTest-525062696 None] Created volume successfully.
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Creating offline snapshot 461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 of volume 726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd59096-5541-4940-8ff5-b934fc1caf57]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:08 devstack sudo[87827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c
Apr 17 05:32:08 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "cinder-805a11b0-c974-4712-8b05-3872d57a5501-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-805a11b0-c974-4712-8b05-3872d57a5501-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "cinder-quobyte-805a11b0-c974-4712-8b05-3872d57a5501" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-quobyte-805a11b0-c974-4712-8b05-3872d57a5501" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:09 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[315b88ae-1db8-424e-82de-b7159dec2921]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:09 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c" returned: 0 in 0.618s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:09 devstack sudo[87832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501
Apr 17 05:32:09 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:09 devstack sudo[87833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 1G
Apr 17 05:32:09 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:09 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501" returned: 0 in 0.640s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:09 devstack sudo[87842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501
Apr 17 05:32:09 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:10 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 1G" returned: 0 in 0.663s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:10 devstack sudo[87844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2
Apr 17 05:32:10 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:10 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-805a11b0-c974-4712-8b05-3872d57a5501" returned: 0 in 0.525s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-quobyte-805a11b0-c974-4712-8b05-3872d57a5501" released by "delete_volume" :: held 1.188s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Created reservations ['c1b6c803-e059-4fd1-8fc7-90930da9eecc', '712c5af5-f9d4-4401-b54c-518c3ab5e01e', '71a892ec-494b-4296-9b4d-dc7bba69736a', 'bd8a652f-db42-4349-9320-ea5f1bdd3991'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:10 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:10 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:10 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2" returned: 0 in 0.612s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:10 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 is being set with open permissions: ugo+rw
Apr 17 05:32:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:10 devstack sudo[87852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2
Apr 17 05:32:10 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:11 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.485s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:11 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Deleted volume successfully.
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e10c50ae-9ac3-408a-86fb-a4cea630cebd tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-805a11b0-c974-4712-8b05-3872d57a5501-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:11 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2" returned: 0 in 0.498s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:11 devstack sudo[87859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.info
Apr 17 05:32:11 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "cinder-2274dd76-125e-4210-a040-cafa47d13ac1-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-2274dd76-125e-4210-a040-cafa47d13ac1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "cinder-quobyte-2274dd76-125e-4210-a040-cafa47d13ac1" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-quobyte-2274dd76-125e-4210-a040-cafa47d13ac1" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c14b87-a56d-40a1-acfd-cd732cfb9e0f]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:11 devstack sudo[87861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1
Apr 17 05:32:11 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:11 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.info" returned: 0 in 0.474s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:11 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.info is being set with open permissions: ugo+rw
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:11 devstack sudo[87864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.info
Apr 17 05:32:11 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:11 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1" returned: 0 in 0.492s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:12 devstack sudo[87870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1
Apr 17 05:32:12 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:12 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.info" returned: 0 in 0.448s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Acquiring lock "cinder-quobyte-2d276da1-0bc3-435a-bc77-950be6acb43b" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Lock "cinder-quobyte-2d276da1-0bc3-435a-bc77-950be6acb43b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] snapshot: 461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2, volume: 2d276da1-0bc3-435a-bc77-950be6acb43b,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d4397a-7fce-4289-9c4e-31b89d1be00d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:12 devstack sudo[87873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2
Apr 17 05:32:12 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:12 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2274dd76-125e-4210-a040-cafa47d13ac1" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-quobyte-2274dd76-125e-4210-a040-cafa47d13ac1" released by "delete_volume" :: held 0.994s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Created reservations ['84b7e409-5fe4-49bd-afe1-d2690db0e824', '7759f7a5-438b-4503-8f5c-3bfb650ac8b4', 'df8cd8d1-0673-4f26-9218-f16c3c73f996', 'b271ead2-ef0e-43ba-996a-da6faa3c8f6d'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:12 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:12 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:12 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2" returned: 0 in 0.537s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[31db5f82-b59c-42c3-b670-11c61ff6cbbc]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:12 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c
Apr 17 05:32:12 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:12 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.445s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:12 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:13 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Deleted volume successfully.
Apr 17 05:32:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5a918e22-48c4-494c-a16a-e4cf0c8c3674 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-2274dd76-125e-4210-a040-cafa47d13ac1-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:13 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c" returned: 0 in 0.506s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:13 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:32:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:13 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b
Apr 17 05:32:13 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "cinder-eac921b5-c973-48d8-a53a-99d4d2a62781-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-eac921b5-c973-48d8-a53a-99d4d2a62781-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "cinder-quobyte-eac921b5-c973-48d8-a53a-99d4d2a62781" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-quobyte-eac921b5-c973-48d8-a53a-99d4d2a62781" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:13 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e9220d-05c5-4de9-8a65-6f62ba55b60a]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:13 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781
Apr 17 05:32:13 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:14 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781" returned: 0 in 1.084s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:14 devstack sudo[87904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781
Apr 17 05:32:14 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:15 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b" returned: 0 in 2.348s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b54df-c8e6-4315-af02-689b4cb7242b]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:15 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-eac921b5-c973-48d8-a53a-99d4d2a62781" returned: 0 in 0.872s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-quobyte-eac921b5-c973-48d8-a53a-99d4d2a62781" released by "delete_volume" :: held 1.977s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Created reservations ['9c90f50e-79dc-4c71-9ca5-1a236db8925a', '20b25e47-72cf-4a2a-83f8-e5e3ceefe91a', 'd23c44b4-bf83-4972-93ca-07f2ff77f0df', '21e9c087-fc20-4445-bf62-f27a301bf908'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:15 devstack sudo[87907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c
Apr 17 05:32:15 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:15 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:15 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "cinder-42e2e8e7-eb31-49a6-a276-206747f6d7f4-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-42e2e8e7-eb31-49a6-a276-206747f6d7f4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "cinder-quobyte-42e2e8e7-eb31-49a6-a276-206747f6d7f4" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-quobyte-42e2e8e7-eb31-49a6-a276-206747f6d7f4" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b68ca8-2a38-49ce-9896-eee5ada619fb]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:15 devstack sudo[87911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4
Apr 17 05:32:15 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:16 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.551s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:16 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:16 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Deleted volume successfully.
Apr 17 05:32:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d6fda5f4-9de3-4e39-a791-2d7ca37f6717 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-eac921b5-c973-48d8-a53a-99d4d2a62781-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:16 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c" returned: 0 in 0.837s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:16 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c, size 1024.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:32:16 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Converted 1024.00 MB image at 435.68 MB/s
Apr 17 05:32:16 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b is being set with open permissions: ugo+rw
Apr 17 05:32:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:16 devstack sudo[87920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b
Apr 17 05:32:16 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:16 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4" returned: 0 in 0.640s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:16 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4
Apr 17 05:32:16 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:16 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b" returned: 0 in 0.576s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Lock "cinder-quobyte-2d276da1-0bc3-435a-bc77-950be6acb43b" released by "_copy_volume_from_snapshot" :: held 4.866s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Acquiring lock "cinder-quobyte-461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Lock "cinder-quobyte-461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:17 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Deleting offline snapshot 461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 of volume 726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] snapshot_file for this snap is: volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-42e2e8e7-eb31-49a6-a276-206747f6d7f4" returned: 0 in 0.511s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[11743048-b413-4041-9987-95008e9a4d7a]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-quobyte-42e2e8e7-eb31-49a6-a276-206747f6d7f4" released by "delete_volume" :: held 1.182s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Created reservations ['7f013735-2df5-4e02-b4eb-89316cf8b32c', '910d9e1e-8c21-4816-a31e-fbf4f98136f4', 'bd35ffab-88e0-43b4-8fd4-a7c950a2e4e4', '9be60fee-ffd5-4a1b-9bc3-ced09bd3d834'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:17 devstack sudo[87927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2
Apr 17 05:32:17 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:17 devstack sudo[87929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:17 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:17 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2" returned: 0 in 0.494s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:32:17 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaff133-7221-48ee-afb7-50a946ad86bc]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.435s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:17 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Deleted volume successfully.
Apr 17 05:32:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-715816bc-8e96-45f4-bbfd-a0309f4d9390 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-42e2e8e7-eb31-49a6-a276-206747f6d7f4-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:17 devstack sudo[87937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c
Apr 17 05:32:17 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "cinder-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "cinder-quobyte-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-quobyte-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:18 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c" returned: 0 in 0.561s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0929e8e9-1881-4a52-b2e3-4c8800884b44]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:18 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2
Apr 17 05:32:18 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:18 devstack sudo[87957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c
Apr 17 05:32:18 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:18 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2" returned: 0 in 0.445s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:18 devstack sudo[87966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2
Apr 17 05:32:18 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:18 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c" returned: 0 in 0.521s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:18 devstack sudo[87968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c
Apr 17 05:32:18 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:18 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c.461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2" returned: 0 in 0.419s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Lock "cinder-quobyte-461af0e3-4ac1-4492-b1ea-4d9ddfe9aba2" released by "_delete_snapshot" :: held 1.981s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.355s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.558s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1728648548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cdd00f-e448-4ae8-8da4-75aed3da39c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79546f194b345c88e8664a4613b7fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:08Z,use_quota=True,user_id='8c9d83ea6001461a9fdeab1f07c92dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Creating volume 69cdd00f-e448-4ae8-8da4-75aed3da39c7 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:19 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f52ff6f-f62f-4588-94bc-5b59ae3a2b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d276da1-0bc3-435a-bc77-950be6acb43b', 'volume_size': 2, 'source_volid': '726c49aa-b1c6-42f5-bd55-7fa115c92a0c', 'source_volstatus': 'available'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:19 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7 1073741824
Apr 17 05:32:19 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7653b336-d039-4f66-826f-5415d385f300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:19 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Volume volume-2d276da1-0bc3-435a-bc77-950be6acb43b (2d276da1-0bc3-435a-bc77-950be6acb43b): created successfully
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7653b336-d039-4f66-826f-5415d385f300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Flow 'volume_create_manager' (bf1c0fc8-a95c-4241-9060-2a4f6af1cab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:19 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-53279e6f-5a15-49f0-b16a-c6c65d833ebf tempest-VolumesCloneTest-1403171735 None] Created volume successfully.
Apr 17 05:32:19 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-quobyte-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c" released by "delete_volume" :: held 1.027s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Created reservations ['c9ea3192-132d-4ffe-b2c3-cbf7b0a0043a', '4a5fa9f5-5573-4040-90f3-0e1420a782a2', '02674048-a795-454d-a089-8c14bba588a8', '7cc2b6e6-947b-4efd-995f-f823b477d673'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:19 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:19 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:19 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7 1073741824" returned: 0 in 0.516s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:19 devstack sudo[87980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7
Apr 17 05:32:19 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:19 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.445s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:19 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Deleted volume successfully.
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0ec02217-a151-4ee4-aa35-dfd218758ce2 tempest-CreateVolumesFromImageTest-525062696 None] Lock "cinder-71c23e4b-1e7d-44ba-a4a1-12c98d6d2c9c-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Acquiring lock "cinder-2d276da1-0bc3-435a-bc77-950be6acb43b-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Lock "cinder-2d276da1-0bc3-435a-bc77-950be6acb43b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Acquiring lock "cinder-quobyte-2d276da1-0bc3-435a-bc77-950be6acb43b" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Lock "cinder-quobyte-2d276da1-0bc3-435a-bc77-950be6acb43b" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[919a3e55-9db3-4e2f-9767-831f2f44fac3]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:19 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b
Apr 17 05:32:19 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:19 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7" returned: 0 in 0.413s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a75e185-6645-49ea-b3e3-b1946d7b0777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d039f9-ef10-41d3-b8fb-3e478bce3fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:20 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Volume volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7 (69cdd00f-e448-4ae8-8da4-75aed3da39c7): created successfully
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d039f9-ef10-41d3-b8fb-3e478bce3fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Flow 'volume_create_manager' (f54fcacb-c24c-4a65-837a-d9761261f7ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:20 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-304f1152-4085-4ecd-b024-ae292fffffa4 tempest-VolumesNegativeTest-203649791 None] Created volume successfully.
Apr 17 05:32:20 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b" returned: 0 in 0.556s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:20 devstack sudo[87991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b
Apr 17 05:32:20 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:20 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2d276da1-0bc3-435a-bc77-950be6acb43b" returned: 0 in 0.461s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Lock "cinder-quobyte-2d276da1-0bc3-435a-bc77-950be6acb43b" released by "delete_volume" :: held 1.038s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Created reservations ['3198abbb-4302-412c-924b-3d44f8a44c83', '56d9539b-f9b6-402d-a6c6-96b20d409656', '1d39f158-7aa5-49ab-ad2a-98f202eaf261', 'c6192e6e-2b73-4f77-bf6d-7ddbea14e636'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:20 devstack sudo[87994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:20 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:21 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.515s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:21 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:21 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Deleted volume successfully.
Apr 17 05:32:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bdfc7902-b1ec-4cb6-9d39-1eab28586db7 tempest-VolumesCloneTest-1403171735 None] Lock "cinder-2d276da1-0bc3-435a-bc77-950be6acb43b-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Acquiring lock "cinder-726c49aa-b1c6-42f5-bd55-7fa115c92a0c-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Lock "cinder-726c49aa-b1c6-42f5-bd55-7fa115c92a0c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Acquiring lock "cinder-quobyte-726c49aa-b1c6-42f5-bd55-7fa115c92a0c" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Lock "cinder-quobyte-726c49aa-b1c6-42f5-bd55-7fa115c92a0c" acquired by "delete_volume" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:22 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9646412-2ab3-42dd-9ebe-9d39e658ddb5]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:22 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c
Apr 17 05:32:22 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:23 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c" returned: 0 in 0.873s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:23 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c
Apr 17 05:32:23 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:23 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-726c49aa-b1c6-42f5-bd55-7fa115c92a0c" returned: 0 in 0.506s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Lock "cinder-quobyte-726c49aa-b1c6-42f5-bd55-7fa115c92a0c" released by "delete_volume" :: held 1.467s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Created reservations ['3df1da5f-ac79-4013-948d-bbbdb7b0bd06', '3a4b7dfe-d01c-4ccd-9f38-d367ff6b4324', '2aa9bbd2-deb3-4ef4-8d1f-e6fcbe177cc0', '105c1fdd-2081-4484-a7d4-eab78c8794c8'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:23 devstack sudo[88037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:23 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:24 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.599s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:24 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Deleted volume successfully.
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e385d969-1d4a-43a1-8c31-b2576504a1bf tempest-VolumesCloneTest-1403171735 None] Lock "cinder-726c49aa-b1c6-42f5-bd55-7fa115c92a0c-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (9a09baee-335d-4cbe-a8e3-4c7fcc19b5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7024ed3f-bd3b-46f4-a25a-d43a3d3dacfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7024ed3f-bd3b-46f4-a25a-d43a3d3dacfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1718685399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd92c9db-b6c4-4989-84f4-a2dd0388d185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:25Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c07fbed-7708-4aa1-a6e0-5529e6ad91fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c07fbed-7708-4aa1-a6e0-5529e6ad91fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c2b36c-dd83-4ddb-a5e9-6c58232e90b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c2b36c-dd83-4ddb-a5e9-6c58232e90b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd92c9db-b6c4-4989-84f4-a2dd0388d185', 'volume_name': 'volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfae2d57-719a-4d0e-adc3-86f04b89720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfae2d57-719a-4d0e-adc3-86f04b89720e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5375ced3-8da4-4efb-9977-bdfcb68b3357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:24 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Volume dd92c9db-b6c4-4989-84f4-a2dd0388d185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185', 'volume_size': 1}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1718685399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd92c9db-b6c4-4989-84f4-a2dd0388d185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:25Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Creating volume dd92c9db-b6c4-4989-84f4-a2dd0388d185 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:24 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:25 devstack sudo[88040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185 1073741824
Apr 17 05:32:25 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:25 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185 1073741824" returned: 0 in 0.770s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:25 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185
Apr 17 05:32:25 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:26 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185" returned: 0 in 0.575s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5375ced3-8da4-4efb-9977-bdfcb68b3357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e421db-a50d-4802-9c9e-94809f8945cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:26 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Volume volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185 (dd92c9db-b6c4-4989-84f4-a2dd0388d185): created successfully
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e421db-a50d-4802-9c9e-94809f8945cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (9a09baee-335d-4cbe-a8e3-4c7fcc19b5e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:26 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d4b4cd15-d46c-422e-9099-c47383dd15e5 tempest-VolumesActionsTest-1224148691 None] Created volume successfully.
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (4547de48-6411-4230-acd2-77abafc7816c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24606d1-fab0-4aae-abe6-4e95b0e327ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24606d1-fab0-4aae-abe6-4e95b0e327ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-623831986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762c48b2-87a7-4a7f-a369-f0b7865df349,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:27Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c469ca-cb56-471c-bb85-38af190de660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c469ca-cb56-471c-bb85-38af190de660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293dbf30-74a7-4edb-ac36-938d749b94d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293dbf30-74a7-4edb-ac36-938d749b94d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762c48b2-87a7-4a7f-a369-f0b7865df349', 'volume_name': 'volume-762c48b2-87a7-4a7f-a369-f0b7865df349', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877cdcc2-d46f-4c4f-9ff7-002800473d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877cdcc2-d46f-4c4f-9ff7-002800473d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1d5d60-1bf7-431e-89b6-2f2e672b831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:27 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Volume 762c48b2-87a7-4a7f-a369-f0b7865df349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762c48b2-87a7-4a7f-a369-f0b7865df349', 'volume_size': 1}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-623831986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762c48b2-87a7-4a7f-a369-f0b7865df349,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:27Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Creating volume 762c48b2-87a7-4a7f-a369-f0b7865df349 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:27 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5a2bb87d-fab7-44fd-aa88-99b752bb6917 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185" by "attach_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5a2bb87d-fab7-44fd-aa88-99b752bb6917 tempest-VolumesActionsTest-1224148691 None] Lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185" acquired by "attach_volume" :: waited 0.023s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:27 devstack sudo[88049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349 1073741824
Apr 17 05:32:27 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:27 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5a2bb87d-fab7-44fd-aa88-99b752bb6917 tempest-VolumesActionsTest-1224148691 None] Attaching volume dd92c9db-b6c4-4989-84f4-a2dd0388d185 to instance 3c97788e-d071-405d-ac89-6f56b09b9cee at mountpoint /dev/vdb on host None.
Apr 17 05:32:27 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5a2bb87d-fab7-44fd-aa88-99b752bb6917 tempest-VolumesActionsTest-1224148691 None] Attach volume completed successfully.
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5a2bb87d-fab7-44fd-aa88-99b752bb6917 tempest-VolumesActionsTest-1224148691 None] Lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185" released by "attach_volume" :: held 0.105s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:27 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349 1073741824" returned: 0 in 0.868s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:28 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349
Apr 17 05:32:28 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:28 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d2d6bf8d-5fb1-4024-9d4a-5e1007c86f20 tempest-VolumesActionsTest-451619735 None] Terminate volume connection completed successfully.
Apr 17 05:32:28 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349" returned: 0 in 0.674s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1d5d60-1bf7-431e-89b6-2f2e672b831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762c48b2-87a7-4a7f-a369-f0b7865df349', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353d3747-beae-47bb-9238-3491a2b6ee55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:28 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Volume volume-762c48b2-87a7-4a7f-a369-f0b7865df349 (762c48b2-87a7-4a7f-a369-f0b7865df349): created successfully
Apr 17 05:32:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353d3747-beae-47bb-9238-3491a2b6ee55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (4547de48-6411-4230-acd2-77abafc7816c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:28 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-57225745-2558-4cab-a915-5bf5effda764 tempest-VolumesGetTest-490539219 None] Created volume successfully.
Apr 17 05:32:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d2d6bf8d-5fb1-4024-9d4a-5e1007c86f20 tempest-VolumesActionsTest-451619735 None] Acquiring lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185-detach_volume" by "detach_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d2d6bf8d-5fb1-4024-9d4a-5e1007c86f20 tempest-VolumesActionsTest-451619735 None] Lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:28 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d2d6bf8d-5fb1-4024-9d4a-5e1007c86f20 tempest-VolumesActionsTest-451619735 None] Detaching volume dd92c9db-b6c4-4989-84f4-a2dd0388d185 from instance 3c97788e-d071-405d-ac89-6f56b09b9cee.
Apr 17 05:32:28 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d2d6bf8d-5fb1-4024-9d4a-5e1007c86f20 tempest-VolumesActionsTest-451619735 None] Detach volume completed successfully.
Apr 17 05:32:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d2d6bf8d-5fb1-4024-9d4a-5e1007c86f20 tempest-VolumesActionsTest-451619735 None] Lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dc41d785-76ee-4f44-8151-25067a06735f tempest-VolumesActionsTest-1224148691 None] Acquiring lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185-detach_volume" by "detach_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dc41d785-76ee-4f44-8151-25067a06735f tempest-VolumesActionsTest-1224148691 None] Lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:29 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dc41d785-76ee-4f44-8151-25067a06735f tempest-VolumesActionsTest-1224148691 None] Volume detach called, but volume not attached.
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dc41d785-76ee-4f44-8151-25067a06735f tempest-VolumesActionsTest-1224148691 None] Lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (1a958651-c481-47a7-ba48-36a387de44a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36a2fbe-d56a-48c5-b632-7cd8131606c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36a2fbe-d56a-48c5-b632-7cd8131606c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-577919471',display_name='tempest-VolumesGetTest-Volume-950629063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea4d28b-aad1-4366-895e-5c1230f1e497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:30Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4da0c7-f6d5-45bc-860a-7dfd74ca7275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4da0c7-f6d5-45bc-860a-7dfd74ca7275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0280207d-5b1d-4fbf-812d-c21d4d9d1294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0280207d-5b1d-4fbf-812d-c21d4d9d1294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea4d28b-aad1-4366-895e-5c1230f1e497', 'volume_name': 'volume-8ea4d28b-aad1-4366-895e-5c1230f1e497', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603399f7-59df-421f-a25b-4b9154f05881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603399f7-59df-421f-a25b-4b9154f05881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76fdfb7-1c08-4118-abcc-8dfed9561a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:29 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Volume 8ea4d28b-aad1-4366-895e-5c1230f1e497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea4d28b-aad1-4366-895e-5c1230f1e497', 'volume_size': 1}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-577919471',display_name='tempest-VolumesGetTest-Volume-950629063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea4d28b-aad1-4366-895e-5c1230f1e497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:30Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Creating volume 8ea4d28b-aad1-4366-895e-5c1230f1e497 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:29 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:29 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497 1073741824
Apr 17 05:32:29 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "cinder-quobyte-dd92c9db-b6c4-4989-84f4-a2dd0388d185" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Lock "cinder-quobyte-dd92c9db-b6c4-4989-84f4-a2dd0388d185" acquired by "delete_volume" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:30 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b78ab9-6e43-4035-9167-300aac39ed06]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:30 devstack sudo[88078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185
Apr 17 05:32:30 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:30 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497 1073741824" returned: 0 in 0.660s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:30 devstack sudo[88080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497
Apr 17 05:32:30 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:30 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185" returned: 0 in 0.642s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:30 devstack sudo[88085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185
Apr 17 05:32:30 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:31 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497" returned: 0 in 0.701s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76fdfb7-1c08-4118-abcc-8dfed9561a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea4d28b-aad1-4366-895e-5c1230f1e497', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6921d9e-82b6-43d0-a90c-cd58d3e0c7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Volume volume-8ea4d28b-aad1-4366-895e-5c1230f1e497 (8ea4d28b-aad1-4366-895e-5c1230f1e497): created successfully
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6921d9e-82b6-43d0-a90c-cd58d3e0c7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (1a958651-c481-47a7-ba48-36a387de44a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:31 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-abcd7bea-e41a-4928-8c6e-c64e4b66344c tempest-VolumesGetTest-490539219 None] Created volume successfully.
Apr 17 05:32:31 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-dd92c9db-b6c4-4989-84f4-a2dd0388d185" returned: 0 in 0.640s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Lock "cinder-quobyte-dd92c9db-b6c4-4989-84f4-a2dd0388d185" released by "delete_volume" :: held 1.304s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Created reservations ['6be9f36a-d9aa-4b5a-bfa6-18306a14bcdc', '0f3964a7-2762-4108-a6f7-1f67d761b351', '55a2a88e-3f0b-4367-8fd2-47d2b21fa0fc', 'e2e562b7-c343-4e69-b572-57f1803ca7dd'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:31 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:31 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-8ea4d28b-aad1-4366-895e-5c1230f1e497-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Lock "cinder-8ea4d28b-aad1-4366-895e-5c1230f1e497-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-quobyte-8ea4d28b-aad1-4366-895e-5c1230f1e497" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-8ea4d28b-aad1-4366-895e-5c1230f1e497" acquired by "delete_volume" :: waited 0.026s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:32 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b684f9-3705-4c31-b4ee-f7c83ca29fe6]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:32 devstack sudo[88094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497
Apr 17 05:32:32 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:32 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.932s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:32 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:32 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Deleted volume successfully.
Apr 17 05:32:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3200b315-82de-42f8-9d6b-5b983eb516a3 tempest-VolumesActionsTest-1224148691 None] Lock "cinder-dd92c9db-b6c4-4989-84f4-a2dd0388d185-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:32 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497" returned: 0 in 0.676s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:32 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497
Apr 17 05:32:32 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:33 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8ea4d28b-aad1-4366-895e-5c1230f1e497" returned: 0 in 0.497s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-8ea4d28b-aad1-4366-895e-5c1230f1e497" released by "delete_volume" :: held 1.207s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Created reservations ['39fd10fe-fb28-4c80-9500-2b850ac9a11f', '1d3c0f4d-1ffb-4407-b36d-9e1457253907', 'c46ec9df-5b49-4af0-978d-1e1f3e0f5d5f', '502174e2-3e7e-4a21-a041-6e677bd10f08'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:33 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:33 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:33 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.513s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Deleted volume successfully.
Apr 17 05:32:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-cddba7c3-db66-427f-860b-3b6826337733 tempest-VolumesGetTest-490539219 None] Lock "cinder-8ea4d28b-aad1-4366-895e-5c1230f1e497-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-762c48b2-87a7-4a7f-a369-f0b7865df349-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Lock "cinder-762c48b2-87a7-4a7f-a369-f0b7865df349-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-quobyte-762c48b2-87a7-4a7f-a369-f0b7865df349" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-762c48b2-87a7-4a7f-a369-f0b7865df349" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:34 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6af4351-e5ea-4511-85ab-ccee431e656f]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:34 devstack sudo[88164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349
Apr 17 05:32:34 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:35 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349" returned: 0 in 0.663s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:35 devstack sudo[88171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349
Apr 17 05:32:35 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:35 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-762c48b2-87a7-4a7f-a369-f0b7865df349" returned: 0 in 0.601s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-762c48b2-87a7-4a7f-a369-f0b7865df349" released by "delete_volume" :: held 1.287s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Created reservations ['ede94b9f-92f3-4793-8b69-fa1eaa92d432', '9e1aa4e8-328c-4766-975c-183c2774833d', '06571df8-3543-4a8c-8859-bc2141a13c63', '88030659-afd2-4a62-acd1-e1a9628a7a17'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:35 devstack sudo[88176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:35 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:36 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.499s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Deleted volume successfully.
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b6e4bec3-3aa3-413d-a1a7-a30bf8a0955e tempest-VolumesGetTest-490539219 None] Lock "cinder-762c48b2-87a7-4a7f-a369-f0b7865df349-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (ee277c17-a407-4f4a-a3f2-217be98b6b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa23eae-f326-467c-8379-8d831a6db93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa23eae-f326-467c-8379-8d831a6db93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-817982103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bb0f95-de30-442c-bbaf-ea80fb557ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:37Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cc1ff7-8a41-4313-9047-7ed953d0e2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cc1ff7-8a41-4313-9047-7ed953d0e2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a920bd-af29-4fea-b91b-3e737b331383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a920bd-af29-4fea-b91b-3e737b331383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36bb0f95-de30-442c-bbaf-ea80fb557ebd', 'volume_name': 'volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12660d85-2543-42e5-a44e-690884068e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12660d85-2543-42e5-a44e-690884068e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16e5282-99a3-4dbd-863e-966f8bfe44ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:36 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Volume 36bb0f95-de30-442c-bbaf-ea80fb557ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd', 'volume_size': 1}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-817982103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bb0f95-de30-442c-bbaf-ea80fb557ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:37Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Creating volume 36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:36 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:36 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd 1073741824
Apr 17 05:32:36 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:37 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd 1073741824" returned: 0 in 0.697s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:37 devstack sudo[88188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd
Apr 17 05:32:37 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:38 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd" returned: 0 in 0.647s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16e5282-99a3-4dbd-863e-966f8bfe44ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36316afa-d553-43a4-99e4-74c54dbdd5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:38 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Volume volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd (36bb0f95-de30-442c-bbaf-ea80fb557ebd): created successfully
Apr 17 05:32:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36316afa-d553-43a4-99e4-74c54dbdd5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (ee277c17-a407-4f4a-a3f2-217be98b6b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:38 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c8a98df0-4b21-47fb-b79c-339a4810cd36 tempest-VolumesGetTest-490539219 None] Created volume successfully.
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (8891a1ff-9fb0-4246-b105-60f776e4c7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed065b12-42fd-47cd-a1cb-fe171352bf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed065b12-42fd-47cd-a1cb-fe171352bf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-743995551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca80aff5-903a-4c0e-80df-d6f9bc9c015b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:39Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bec00d5-8408-4428-9d1f-4179a4bc6d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bec00d5-8408-4428-9d1f-4179a4bc6d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b213a1-dca2-449c-b063-730bfedb7bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b213a1-dca2-449c-b063-730bfedb7bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca80aff5-903a-4c0e-80df-d6f9bc9c015b', 'volume_name': 'volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac84bfe4-1f3a-4777-98f0-7519144dddd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac84bfe4-1f3a-4777-98f0-7519144dddd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690f2122-c272-4e84-9942-219521664df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:39 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Volume ca80aff5-903a-4c0e-80df-d6f9bc9c015b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b', 'volume_size': 1}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-743995551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca80aff5-903a-4c0e-80df-d6f9bc9c015b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:39Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Creating volume ca80aff5-903a-4c0e-80df-d6f9bc9c015b {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:39 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:39 devstack sudo[88191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b 1073741824
Apr 17 05:32:39 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (b9c1df74-8018-4aab-a23b-1f0ba3cf7f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a21e69e-b33b-409e-bedf-eb86639afd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a21e69e-b33b-409e-bedf-eb86639afd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1912162743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edefd66-3555-4e13-87d8-9da9209f21e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=36bb0f95-de30-442c-bbaf-ea80fb557ebd,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:39Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fc9cd5-2673-44ac-b832-9dd4551aceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fc9cd5-2673-44ac-b832-9dd4551aceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ab674e-7109-4152-8630-177fca908925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ab674e-7109-4152-8630-177fca908925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5edefd66-3555-4e13-87d8-9da9209f21e2', 'volume_name': 'volume-5edefd66-3555-4e13-87d8-9da9209f21e2', 'volume_size': 1, 'source_volid': '36bb0f95-de30-442c-bbaf-ea80fb557ebd', 'source_volstatus': 'available'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac42e3c-d41a-4f4c-a4f5-e3236ef7f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac42e3c-d41a-4f4c-a4f5-e3236ef7f935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804e723e-d670-446d-bda6-91747b77e047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:39 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Volume 5edefd66-3555-4e13-87d8-9da9209f21e2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5edefd66-3555-4e13-87d8-9da9209f21e2', 'volume_size': 1, 'source_volid': '36bb0f95-de30-442c-bbaf-ea80fb557ebd', 'source_volstatus': 'available'}
Apr 17 05:32:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:40 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b 1073741824" returned: 0 in 0.962s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:40 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b
Apr 17 05:32:40 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:40 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b" returned: 0 in 0.630s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.231s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:40 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Cloning volume 36bb0f95-de30-442c-bbaf-ea80fb557ebd to volume 5edefd66-3555-4e13-87d8-9da9209f21e2
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Creating offline snapshot 1914b461-bb81-4a69-9f4f-668a2f789552 of volume 36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690f2122-c272-4e84-9942-219521664df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9a3409-50aa-418c-bd5a-03c8b7e05517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa30ce8-c31b-4b35-ad99-6592d06bbb7f]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:40 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Volume volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b (ca80aff5-903a-4c0e-80df-d6f9bc9c015b): created successfully
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9a3409-50aa-418c-bd5a-03c8b7e05517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:40 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (8891a1ff-9fb0-4246-b105-60f776e4c7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:40 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d876b0ff-eec2-46f5-8ec3-8267586cfab8 tempest-VolumesActionsTest-1224148691 None] Created volume successfully.
Apr 17 05:32:40 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd
Apr 17 05:32:40 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Acquiring lock "cinder-ca80aff5-903a-4c0e-80df-d6f9bc9c015b-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Lock "cinder-ca80aff5-903a-4c0e-80df-d6f9bc9c015b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Acquiring lock "cinder-quobyte-ca80aff5-903a-4c0e-80df-d6f9bc9c015b" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Lock "cinder-quobyte-ca80aff5-903a-4c0e-80df-d6f9bc9c015b" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd5fdc5-379d-4c55-b44e-0c75e27a3fc4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:41 devstack sudo[88229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b
Apr 17 05:32:41 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:41 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd" returned: 0 in 0.570s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:41 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 1G
Apr 17 05:32:41 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Flow 'volume_create_manager' (6f8d1923-f5b3-48f0-8827-133ff6bda703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28185345-fb6b-4d50-b7ea-1afea90c76b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28185345-fb6b-4d50-b7ea-1afea90c76b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1035346876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d449eb-4cad-4feb-9200-424f41f0e050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42a72af8d1e4848bb129fa045de1d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:42Z,use_quota=True,user_id='1b770a1f88314e37a6d95e35be29e95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c454f40-64bf-4cb2-83f9-20a8888d3681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c454f40-64bf-4cb2-83f9-20a8888d3681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11e4bf5-a3c7-4d8a-a972-64c821e629ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11e4bf5-a3c7-4d8a-a972-64c821e629ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d449eb-4cad-4feb-9200-424f41f0e050', 'volume_name': 'volume-09d449eb-4cad-4feb-9200-424f41f0e050', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bb068c-f428-4b4b-909f-d096f9f5535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bb068c-f428-4b4b-909f-d096f9f5535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60973180-566b-4291-b082-94ecb1289865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:41 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Volume 09d449eb-4cad-4feb-9200-424f41f0e050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d449eb-4cad-4feb-9200-424f41f0e050', 'volume_size': 1}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:41 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b" returned: 0 in 0.589s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:41 devstack sudo[88242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b
Apr 17 05:32:41 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:41 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 1G" returned: 0 in 0.513s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:42 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552
Apr 17 05:32:42 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:42 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ca80aff5-903a-4c0e-80df-d6f9bc9c015b" returned: 0 in 0.459s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Lock "cinder-quobyte-ca80aff5-903a-4c0e-80df-d6f9bc9c015b" released by "delete_volume" :: held 1.087s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Created reservations ['210ffb7d-e541-4d24-ab65-8d4ba936be83', 'fec062d5-bb7b-41ab-b4cf-1663bbafc4f6', '22cca082-a53c-48c3-b407-7c67d549560c', 'cdc8e0bf-2c2e-4bb3-85b4-f01c9380a07a'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:42 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552" returned: 0 in 0.498s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:42 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 is being set with open permissions: ugo+rw
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:42 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552
Apr 17 05:32:42 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:42 devstack sudo[88254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:42 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:42 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552" returned: 0 in 0.427s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:42 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.443s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:42 devstack sudo[88258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.info
Apr 17 05:32:42 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:42 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Deleted volume successfully.
Apr 17 05:32:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0c4b895c-6639-4d66-81de-db9a3e48f50f tempest-VolumesActionsTest-451619735 None] Lock "cinder-ca80aff5-903a-4c0e-80df-d6f9bc9c015b-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:43 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.info" returned: 0 in 0.428s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:43 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.info is being set with open permissions: ugo+rw
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:43 devstack sudo[88261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.info
Apr 17 05:32:43 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:43 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (cb65ccb4-7614-4f1a-b3af-c30d580635b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fb25b0-069a-42cf-bac8-73dd245a7cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fb25b0-069a-42cf-bac8-73dd245a7cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-715704920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8273bbea-f3b7-4a03-8a3a-541137199007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:44Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b840e07-5e93-4995-9d71-304b29ee6986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b840e07-5e93-4995-9d71-304b29ee6986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9433d295-103c-4bcf-ab8a-29c5ee949cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9433d295-103c-4bcf-ab8a-29c5ee949cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8273bbea-f3b7-4a03-8a3a-541137199007', 'volume_name': 'volume-8273bbea-f3b7-4a03-8a3a-541137199007', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817215f8-c57a-4e19-bb49-0e1ab8dc954f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817215f8-c57a-4e19-bb49-0e1ab8dc954f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0c36d8-baff-404b-9040-a782da705db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:43 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Volume 8273bbea-f3b7-4a03-8a3a-541137199007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8273bbea-f3b7-4a03-8a3a-541137199007', 'volume_size': 1}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.info" returned: 0 in 0.527s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-quobyte-5edefd66-3555-4e13-87d8-9da9209f21e2" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-5edefd66-3555-4e13-87d8-9da9209f21e2" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] snapshot: 1914b461-bb81-4a69-9f4f-668a2f789552, volume: 5edefd66-3555-4e13-87d8-9da9209f21e2,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb943bdc-72d3-401d-adf5-6cb2a2357e71]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:43 devstack sudo[88264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552
Apr 17 05:32:43 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:44 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552" returned: 0 in 0.473s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:44 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:32:44 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:32:44 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:32:44 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a94756-ddef-4233-a848-8b625e80ae11]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:44 devstack sudo[88269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd
Apr 17 05:32:44 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:44 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd" returned: 0 in 0.500s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:44 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2 not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:32:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:44 devstack sudo[88274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2
Apr 17 05:32:44 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:47 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2" returned: 0 in 2.352s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:47 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6199519-ec45-4b72-b5fb-f0e1b0b7160e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:47 devstack sudo[88295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd
Apr 17 05:32:47 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:47 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd" returned: 0 in 0.635s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:47 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd, size 1024.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2 {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:32:47 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Converted 1024.00 MB image at 435.06 MB/s
Apr 17 05:32:47 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2 is being set with open permissions: ugo+rw
Apr 17 05:32:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:47 devstack sudo[88301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2
Apr 17 05:32:47 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:48 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2" returned: 0 in 0.464s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-5edefd66-3555-4e13-87d8-9da9209f21e2" released by "_copy_volume_from_snapshot" :: held 4.485s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-quobyte-1914b461-bb81-4a69-9f4f-668a2f789552" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-1914b461-bb81-4a69-9f4f-668a2f789552" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Deleting offline snapshot 1914b461-bb81-4a69-9f4f-668a2f789552 of volume 36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] snapshot_file for this snap is: volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eebff3-ace1-4234-b3cf-46781482c364]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:48 devstack sudo[88305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552
Apr 17 05:32:48 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:48 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552" returned: 0 in 0.489s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3c4f66-1b2a-4527-b048-dfc6bc3c9aa8]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:49 devstack sudo[88310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd
Apr 17 05:32:49 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:49 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd" returned: 0 in 0.517s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:49 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552
Apr 17 05:32:49 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:49 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552" returned: 0 in 0.486s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:49 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552
Apr 17 05:32:49 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:50 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Acquiring lock "cinder-69cdd00f-e448-4ae8-8da4-75aed3da39c7-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd.1914b461-bb81-4a69-9f4f-668a2f789552" returned: 0 in 0.502s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Lock "cinder-69cdd00f-e448-4ae8-8da4-75aed3da39c7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-1914b461-bb81-4a69-9f4f-668a2f789552" released by "_delete_snapshot" :: held 2.065s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Acquiring lock "cinder-quobyte-69cdd00f-e448-4ae8-8da4-75aed3da39c7" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.640s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.722s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1035346876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d449eb-4cad-4feb-9200-424f41f0e050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42a72af8d1e4848bb129fa045de1d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:42Z,use_quota=True,user_id='1b770a1f88314e37a6d95e35be29e95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Creating volume 09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:50 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804e723e-d670-446d-bda6-91747b77e047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5edefd66-3555-4e13-87d8-9da9209f21e2', 'volume_size': 1, 'source_volid': '36bb0f95-de30-442c-bbaf-ea80fb557ebd', 'source_volstatus': 'available'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:50 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 1073741824
Apr 17 05:32:50 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d67085-1688-4898-8c4c-bfb38fc49a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Lock "cinder-quobyte-69cdd00f-e448-4ae8-8da4-75aed3da39c7" acquired by "delete_volume" :: waited 0.051s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:50 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Volume volume-5edefd66-3555-4e13-87d8-9da9209f21e2 (5edefd66-3555-4e13-87d8-9da9209f21e2): created successfully
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d67085-1688-4898-8c4c-bfb38fc49a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (b9c1df74-8018-4aab-a23b-1f0ba3cf7f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b6348a-65be-4c58-b3ad-362486667e2e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:50 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3e1b6990-6d87-4d81-a6d6-7bf9229b4d7a tempest-VolumesGetTest-490539219 None] Created volume successfully.
Apr 17 05:32:50 devstack sudo[88325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7
Apr 17 05:32:50 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:50 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 1073741824" returned: 0 in 0.486s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:51 devstack sudo[88333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050
Apr 17 05:32:51 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:51 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7" returned: 0 in 0.490s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:51 devstack sudo[88335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7
Apr 17 05:32:51 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:51 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050" returned: 0 in 0.464s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.605s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-715704920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8273bbea-f3b7-4a03-8a3a-541137199007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:44Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Creating volume 8273bbea-f3b7-4a03-8a3a-541137199007 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:51 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:51 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-69cdd00f-e448-4ae8-8da4-75aed3da39c7" returned: 0 in 0.463s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:51 devstack sudo[88339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007 1073741824
Apr 17 05:32:51 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60973180-566b-4291-b082-94ecb1289865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d449eb-4cad-4feb-9200-424f41f0e050', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17477eb-3152-4596-bb66-4450c8a9a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Lock "cinder-quobyte-69cdd00f-e448-4ae8-8da4-75aed3da39c7" released by "delete_volume" :: held 1.012s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:51 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Volume volume-09d449eb-4cad-4feb-9200-424f41f0e050 (09d449eb-4cad-4feb-9200-424f41f0e050): created successfully
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17477eb-3152-4596-bb66-4450c8a9a991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Flow 'volume_create_manager' (6f8d1923-f5b3-48f0-8827-133ff6bda703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:51 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7f49e9ab-5c50-4aaf-8ce0-8530ad796ab7 tempest-SnapshotDependencyTests-57026698 None] Created volume successfully.
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Created reservations ['5a39d4af-da1e-4024-b0c2-5d0d8578cd28', '7b789dd6-af28-4302-a78e-8663a27e7d37', 'fbd0a11b-ccca-4152-8448-0121d5fdb66d', '13e1e513-8b91-4b8e-80b7-3221e4e52e4b'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:51 devstack sudo[88341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:51 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (b7bcd949-d545-42bd-88e1-27ce420a6009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bdd8245-fbca-49af-b2e8-d4ec7126bb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bdd8245-fbca-49af-b2e8-d4ec7126bb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-207379736',display_name='tempest-VolumesGetTest-Volume-796962845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d252623-177e-4fe5-b79c-668daf132f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:52Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e41549-5cd8-44db-a2a7-4190706f8dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e41549-5cd8-44db-a2a7-4190706f8dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be50052-07c1-4832-b57e-63ba5a940f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be50052-07c1-4832-b57e-63ba5a940f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d252623-177e-4fe5-b79c-668daf132f11', 'volume_name': 'volume-5d252623-177e-4fe5-b79c-668daf132f11', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809b1ca4-1de9-4389-b2c4-72750ab23b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809b1ca4-1de9-4389-b2c4-72750ab23b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544dce42-cf6a-4e88-b661-988e998db57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:51 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Volume 5d252623-177e-4fe5-b79c-668daf132f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d252623-177e-4fe5-b79c-668daf132f11', 'volume_size': 1}
Apr 17 05:32:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:52 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007 1073741824" returned: 0 in 0.515s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:52 devstack sudo[88347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007
Apr 17 05:32:52 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:52 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.441s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:52 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Deleted volume successfully.
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7fecd02f-8a1d-46bb-85b0-6b293fa9260c tempest-VolumesNegativeTest-203649791 None] Lock "cinder-69cdd00f-e448-4ae8-8da4-75aed3da39c7-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:52 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007" returned: 0 in 0.453s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-207379736',display_name='tempest-VolumesGetTest-Volume-796962845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d252623-177e-4fe5-b79c-668daf132f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:52Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Creating volume 5d252623-177e-4fe5-b79c-668daf132f11 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:52 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:52 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11 1073741824
Apr 17 05:32:52 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0c36d8-baff-404b-9040-a782da705db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8273bbea-f3b7-4a03-8a3a-541137199007', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39e7c11-e180-4357-b3b1-2b810ae09549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:52 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Volume volume-8273bbea-f3b7-4a03-8a3a-541137199007 (8273bbea-f3b7-4a03-8a3a-541137199007): created successfully
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39e7c11-e180-4357-b3b1-2b810ae09549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (cb65ccb4-7614-4f1a-b3af-c30d580635b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:52 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-11cfc79e-c031-4dfe-b0ae-b0f0f03907f9 tempest-VolumesActionsTest-1224148691 None] Created volume successfully.
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_service.periodic_task [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:52 devstack sudo[88352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:52 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:53 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11 1073741824" returned: 0 in 0.517s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:53 devstack sudo[88357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11
Apr 17 05:32:53 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:53 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.503s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Acquiring lock "cinder-8273bbea-f3b7-4a03-8a3a-541137199007-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Lock "cinder-8273bbea-f3b7-4a03-8a3a-541137199007-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Acquiring lock "cinder-quobyte-8273bbea-f3b7-4a03-8a3a-541137199007" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Lock "cinder-quobyte-8273bbea-f3b7-4a03-8a3a-541137199007" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c6687f-0807-4c6b-8ccf-dfe10d719b20]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:53 devstack sudo[88361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007
Apr 17 05:32:53 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:53 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11" returned: 0 in 0.518s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.140s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Creating offline snapshot bfda20e2-46ac-4497-be38-71aba2e92541 of volume 09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544dce42-cf6a-4e88-b661-988e998db57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d252623-177e-4fe5-b79c-668daf132f11', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f521ec8-6859-4139-9319-ec4da89704d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c635b3-5ed0-4f68-8034-2ce0ed7d1b5b]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:53 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Volume volume-5d252623-177e-4fe5-b79c-668daf132f11 (5d252623-177e-4fe5-b79c-668daf132f11): created successfully
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f521ec8-6859-4139-9319-ec4da89704d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (b7bcd949-d545-42bd-88e1-27ce420a6009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:53 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7c231eb6-1913-472c-8172-0824d95d60b8 tempest-VolumesGetTest-490539219 None] Created volume successfully.
Apr 17 05:32:53 devstack sudo[88363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050
Apr 17 05:32:53 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-5d252623-177e-4fe5-b79c-668daf132f11-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Lock "cinder-5d252623-177e-4fe5-b79c-668daf132f11-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-quobyte-5d252623-177e-4fe5-b79c-668daf132f11" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-5d252623-177e-4fe5-b79c-668daf132f11" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c866497-df61-41be-986b-c9e9d14ec8dc]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:54 devstack sudo[88368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11
Apr 17 05:32:54 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:54 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007" returned: 0 in 0.661s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:54 devstack sudo[88373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007
Apr 17 05:32:54 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Flow 'volume_create_manager' (25b902e5-5940-4886-ab69-277b35b8ed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cc6dac-98f0-4e12-af09-cc645615f619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cc6dac-98f0-4e12-af09-cc645615f619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-134413837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83103005-95e5-410b-b0da-64e6b1eb46c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b4c1113ce44e1897d55d6a63e7632d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:54Z,use_quota=True,user_id='de3f849a07d34b1fbf08c5536d913b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327a80da-f8df-4e8f-bbc1-0e2a9d9e101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327a80da-f8df-4e8f-bbc1-0e2a9d9e101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a10da3-1c0e-4e0e-b00e-f27361b6ffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a10da3-1c0e-4e0e-b00e-f27361b6ffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83103005-95e5-410b-b0da-64e6b1eb46c1', 'volume_name': 'volume-83103005-95e5-410b-b0da-64e6b1eb46c1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5ca254-9a26-4e29-af8d-1e3e5227eb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:54 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5ca254-9a26-4e29-af8d-1e3e5227eb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffef341-c47d-4185-8519-fb1d498017a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:54 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Volume 83103005-95e5-410b-b0da-64e6b1eb46c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83103005-95e5-410b-b0da-64e6b1eb46c1', 'volume_size': 1}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050" returned: 0 in 0.619s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:54 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 1G
Apr 17 05:32:54 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:54 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11" returned: 0 in 0.574s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:54 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8273bbea-f3b7-4a03-8a3a-541137199007" returned: 0 in 0.446s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Lock "cinder-quobyte-8273bbea-f3b7-4a03-8a3a-541137199007" released by "delete_volume" :: held 1.136s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:54 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11
Apr 17 05:32:54 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Created reservations ['b92c124d-6415-4026-8e51-ebc650df2188', '04c09817-c772-4cd1-961c-a24adb6415c6', 'f32f308f-c414-4631-9846-76a30d84bcb5', '7378a1c3-5a7d-4dfa-8356-51d28fbe71cc'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:54 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:54 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:54 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 1G" returned: 0 in 0.500s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09d449eb-4cad-4feb-9200-424f41f0e050 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:54 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09d449eb-4cad-4feb-9200-424f41f0e050 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541
Apr 17 05:32:54 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:55 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5d252623-177e-4fe5-b79c-668daf132f11" returned: 0 in 0.460s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-5d252623-177e-4fe5-b79c-668daf132f11" released by "delete_volume" :: held 1.058s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Created reservations ['4834e8f0-b7ef-4cb9-9004-75d88ca1ff8c', 'd63bd0b9-a910-498a-9916-7d6be2865446', '61d3281c-5d27-4fd7-9977-c000345c2600', '25ce66b1-b524-4ba1-9c37-7a17610246f1'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:55 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:55 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:55 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.469s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:55 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Deleted volume successfully.
Apr 17 05:32:55 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-05ef7806-9f8a-44d1-92e3-fff4fc1f56f3 tempest-VolumesActionsTest-451619735 None] Lock "cinder-8273bbea-f3b7-4a03-8a3a-541137199007-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09d449eb-4cad-4feb-9200-424f41f0e050 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541" returned: 0 in 0.441s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:55 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 is being set with open permissions: ugo+rw
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:55 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541
Apr 17 05:32:55 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:55 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.419s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:55 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Deleted volume successfully.
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3ecbc019-21c9-4d59-8f64-bd97b0d91868 tempest-VolumesGetTest-490539219 None] Lock "cinder-5d252623-177e-4fe5-b79c-668daf132f11-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:55 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541" returned: 0 in 0.442s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:55 devstack sudo[88401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.info
Apr 17 05:32:55 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (053af76c-3aa6-4624-a438-ba18b06b4f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a08c1f-d372-4cb2-857c-88436e41bc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a08c1f-d372-4cb2-857c-88436e41bc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2022335218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a5ae09-0fac-40f8-a9bd-f13b596ff861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:56Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d40df7-c3d4-4e6f-a936-16c8659d6423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d40df7-c3d4-4e6f-a936-16c8659d6423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7456f6cf-96a4-46e6-861a-86d8d2ff4780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7456f6cf-96a4-46e6-861a-86d8d2ff4780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a5ae09-0fac-40f8-a9bd-f13b596ff861', 'volume_name': 'volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6c383a-19c3-4fc1-bffa-fbc8aed99ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6c383a-19c3-4fc1-bffa-fbc8aed99ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fea612-f8ef-4eb2-a736-c7d961f43072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:55 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Volume 99a5ae09-0fac-40f8-a9bd-f13b596ff861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861', 'volume_size': 1}
Apr 17 05:32:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:56 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.info" returned: 0 in 0.433s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:56 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.info is being set with open permissions: ugo+rw
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:56 devstack sudo[88404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.info
Apr 17 05:32:56 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-5edefd66-3555-4e13-87d8-9da9209f21e2-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Lock "cinder-5edefd66-3555-4e13-87d8-9da9209f21e2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-quobyte-5edefd66-3555-4e13-87d8-9da9209f21e2" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-5edefd66-3555-4e13-87d8-9da9209f21e2" acquired by "delete_volume" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3867ab7-31ca-4c4f-aa3a-f663418b2447]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:56 devstack sudo[88406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2
Apr 17 05:32:56 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:56 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.info" returned: 0 in 0.416s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.926s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-134413837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83103005-95e5-410b-b0da-64e6b1eb46c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b4c1113ce44e1897d55d6a63e7632d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:54Z,use_quota=True,user_id='de3f849a07d34b1fbf08c5536d913b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Creating volume 83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:56 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:56 devstack sudo[88409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1 1073741824
Apr 17 05:32:56 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:56 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e713208b-36a3-4d73-b89c-59a36316a6c1 tempest-SnapshotDependencyTests-57026698 None] Create snapshot completed successfully
Apr 17 05:32:56 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2" returned: 0 in 0.494s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:56 devstack sudo[88414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2
Apr 17 05:32:56 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:56 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1 1073741824" returned: 0 in 0.484s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:57 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1
Apr 17 05:32:57 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:57 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5edefd66-3555-4e13-87d8-9da9209f21e2" returned: 0 in 0.412s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-5edefd66-3555-4e13-87d8-9da9209f21e2" released by "delete_volume" :: held 0.927s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Created reservations ['0b9aa53c-0f0d-459c-95b8-1165111a0e44', 'edea2d37-71f3-4a23-8b0f-97acbd616261', '990807f6-5562-4101-9348-d10f4f73a0b2', '135cf7ec-37ca-4b19-ac50-93faf7104585'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:57 devstack sudo[88423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:57 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-36bb0f95-de30-442c-bbaf-ea80fb557ebd-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Lock "cinder-36bb0f95-de30-442c-bbaf-ea80fb557ebd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-quobyte-36bb0f95-de30-442c-bbaf-ea80fb557ebd" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-36bb0f95-de30-442c-bbaf-ea80fb557ebd" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01d33e6-587f-4c90-9684-9eca175364f7]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:57 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd
Apr 17 05:32:57 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:57 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1" returned: 0 in 0.431s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2022335218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a5ae09-0fac-40f8-a9bd-f13b596ff861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:56Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Creating volume 99a5ae09-0fac-40f8-a9bd-f13b596ff861 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:57 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffef341-c47d-4185-8519-fb1d498017a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83103005-95e5-410b-b0da-64e6b1eb46c1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf1289a-92b6-4396-ad18-da30c58fe30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:57 devstack sudo[88428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861 1073741824
Apr 17 05:32:57 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:57 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Volume volume-83103005-95e5-410b-b0da-64e6b1eb46c1 (83103005-95e5-410b-b0da-64e6b1eb46c1): created successfully
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf1289a-92b6-4396-ad18-da30c58fe30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Flow 'volume_create_manager' (25b902e5-5940-4886-ab69-277b35b8ed21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:57 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3154ebf3-aff7-4901-8a19-ccc7bb3d10fc tempest-VolumesSnapshotListTestJSON-325166181 None] Created volume successfully.
Apr 17 05:32:57 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.446s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:57 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Deleted volume successfully.
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ac355a24-c9cd-4b7c-a564-99999ed44f42 tempest-VolumesGetTest-490539219 None] Lock "cinder-5edefd66-3555-4e13-87d8-9da9209f21e2-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:57 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd" returned: 0 in 0.501s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:57 devstack sudo[88436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd
Apr 17 05:32:57 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Flow 'volume_create_manager' (3e0a73d3-208a-4e43-be89-1101d3828c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cbe510-8854-4495-908b-3432c627639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cbe510-8854-4495-908b-3432c627639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed940eb8-3057-4db8-b730-a8c513c5a54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42a72af8d1e4848bb129fa045de1d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bfda20e2-46ac-4497-be38-71aba2e92541,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:32:58Z,use_quota=True,user_id='1b770a1f88314e37a6d95e35be29e95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e779f283-0828-4c62-9cbe-6118bd58e0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e779f283-0828-4c62-9cbe-6118bd58e0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c44cd2-9e69-4ccb-83d4-79ed37f1d9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c44cd2-9e69-4ccb-83d4-79ed37f1d9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed940eb8-3057-4db8-b730-a8c513c5a54d', 'volume_name': 'volume-ed940eb8-3057-4db8-b730-a8c513c5a54d', 'volume_size': 1, 'snapshot_id': 'bfda20e2-46ac-4497-be38-71aba2e92541'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fce8f9c-8423-4108-8a75-c6a0b418cb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fce8f9c-8423-4108-8a75-c6a0b418cb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fec0e6-ee05-4c08-8675-3f50668759f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:58 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Volume ed940eb8-3057-4db8-b730-a8c513c5a54d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed940eb8-3057-4db8-b730-a8c513c5a54d', 'volume_size': 1, 'snapshot_id': 'bfda20e2-46ac-4497-be38-71aba2e92541'}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:58 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861 1073741824" returned: 0 in 0.572s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:58 devstack sudo[88439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861
Apr 17 05:32:58 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:58 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-36bb0f95-de30-442c-bbaf-ea80fb557ebd" returned: 0 in 0.441s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-36bb0f95-de30-442c-bbaf-ea80fb557ebd" released by "delete_volume" :: held 0.972s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Created reservations ['25449cd9-7f49-4741-bc97-ce08199597e3', '9e0b4906-3716-4045-bdde-71d6159a78f7', 'c0311ac2-ca47-4dcc-9b0c-e4e22a7e0b9e', 'ac5c8c93-1b2b-42a2-8bd8-207834cc7547'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:58 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:32:58 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:58 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861" returned: 0 in 0.455s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.492s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "cinder-quobyte-bfda20e2-46ac-4497-be38-71aba2e92541-ed940eb8-3057-4db8-b730-a8c513c5a54d" by "_create_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fea612-f8ef-4eb2-a736-c7d961f43072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a989fe00-8242-4fbf-b5f3-e7827346af6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-bfda20e2-46ac-4497-be38-71aba2e92541-ed940eb8-3057-4db8-b730-a8c513c5a54d" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Creating volume ed940eb8-3057-4db8-b730-a8c513c5a54d from snapshot bfda20e2-46ac-4497-be38-71aba2e92541 {{(pid=82266) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "cinder-quobyte-ed940eb8-3057-4db8-b730-a8c513c5a54d" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:58 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Volume volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861 (99a5ae09-0fac-40f8-a9bd-f13b596ff861): created successfully
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a989fe00-8242-4fbf-b5f3-e7827346af6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (053af76c-3aa6-4624-a438-ba18b06b4f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-ed940eb8-3057-4db8-b730-a8c513c5a54d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] snapshot: bfda20e2-46ac-4497-be38-71aba2e92541, volume: ed940eb8-3057-4db8-b730-a8c513c5a54d,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:32:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a7b337dc-1309-48fe-afd9-19bd9d902c18 tempest-VolumesActionsTest-1224148691 None] Created volume successfully.
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54807a0-5abb-4461-a33d-57a62bbcf77a]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:58 devstack sudo[88445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541
Apr 17 05:32:58 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:58 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.434s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:32:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Deleted volume successfully.
Apr 17 05:32:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fb8b9ef-8519-4b3e-aca0-3291b90d9923 tempest-VolumesGetTest-490539219 None] Lock "cinder-36bb0f95-de30-442c-bbaf-ea80fb557ebd-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:32:59 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541" returned: 0 in 0.501s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09d449eb-4cad-4feb-9200-424f41f0e050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[319e1e39-8bdc-43f0-9718-5fbc93361e97]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Acquiring lock "cinder-99a5ae09-0fac-40f8-a9bd-f13b596ff861-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Lock "cinder-99a5ae09-0fac-40f8-a9bd-f13b596ff861-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Acquiring lock "cinder-quobyte-99a5ae09-0fac-40f8-a9bd-f13b596ff861" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Lock "cinder-quobyte-99a5ae09-0fac-40f8-a9bd-f13b596ff861" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8ee477-d599-40e3-8119-5a2c3b4987cc]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:59 devstack sudo[88451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050
Apr 17 05:32:59 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:59 devstack sudo[88452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861
Apr 17 05:32:59 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:59 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050" returned: 0 in 0.542s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:59 devstack sudo[88461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d
Apr 17 05:32:59 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:59 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861" returned: 0 in 0.512s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:32:59 devstack sudo[88463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861
Apr 17 05:32:59 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (29839f86-57b7-48bb-8a1c-5b314803946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24884b8e-0b00-46ca-86c1-f99d3ad92229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24884b8e-0b00-46ca-86c1-f99d3ad92229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-826535991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85e6aa4-249f-4188-982d-741b02539371,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:00Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a0eef2-12ab-4f1b-b33e-18dbeee550e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a0eef2-12ab-4f1b-b33e-18dbeee550e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765f8142-d558-4223-a506-db800d30488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:32:59 devstack cinder-volume[82266]: DEBUG cinder.image.glance [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Creating Keystone auth plugin from conf {{(pid=82266) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765f8142-d558-4223-a506-db800d30488f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e85e6aa4-249f-4188-982d-741b02539371', 'volume_name': 'volume-e85e6aa4-249f-4188-982d-741b02539371', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536d8cec50>}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3ea203-f892-4d7c-89d8-246ebd817556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3ea203-f892-4d7c-89d8-246ebd817556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb885acb-f534-4c3f-b226-67dba3669e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:00 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Volume e85e6aa4-249f-4188-982d-741b02539371: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e85e6aa4-249f-4188-982d-741b02539371', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536d8cec50>}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Trying to clone e85e6aa4-249f-4188-982d-741b02539371 from image f11dd628-d05d-412e-b4ef-be70c4399345 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]). {{(pid=82266) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 17 05:33:00 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-99a5ae09-0fac-40f8-a9bd-f13b596ff861" returned: 0 in 0.574s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Lock "cinder-quobyte-99a5ae09-0fac-40f8-a9bd-f13b596ff861" released by "delete_volume" :: held 1.114s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=140,cinder:UPDATE=187,cinder:INSERT=36,cinder:DELETE=20 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=149,cinder:UPDATE=218,cinder:INSERT=58,cinder:DELETE=17 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Created reservations ['08b4df00-51bb-4a20-a838-fcc3b4ff471c', 'd382534b-c325-4a7f-8705-ad0dc4e19534', '8b79748f-de0a-4b68-a54b-722902ad6718', 'e0ff5f96-df0f-4ada-a03a-bd0a5fcb7730'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:00 devstack sudo[88477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:00 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 17 05:33:00 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Image download 20.69 MB at 20.69 MB/s
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b050b-1de9-4815-98c9-b265c8519094]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:01 devstack sudo[88479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD
Apr 17 05:33:01 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:01 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.850s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:01 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:01 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Deleted volume successfully.
Apr 17 05:33:01 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-748fb568-aa91-4621-92a1-81fe13805997 tempest-VolumesActionsTest-451619735 None] Lock "cinder-99a5ae09-0fac-40f8-a9bd-f13b596ff861-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:01 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (294e8fa5-40b1-4cc2-af2e-b7b2aadd7981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e64391-58c6-4dfa-bc4d-554e281c3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e64391-58c6-4dfa-bc4d-554e281c3058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-903711355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf06879-8389-4be0-a6b5-461940517653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:02Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0b76f4-3bd0-4532-9299-f06954d1b16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0b76f4-3bd0-4532-9299-f06954d1b16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6befd2-93e6-416f-9041-651cb666ff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6befd2-93e6-416f-9041-651cb666ff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cf06879-8389-4be0-a6b5-461940517653', 'volume_name': 'volume-8cf06879-8389-4be0-a6b5-461940517653', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9709e67e-335b-4bf8-ac6f-069de5062213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9709e67e-335b-4bf8-ac6f-069de5062213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83dc6f85-eedd-4025-bb8e-a81888da4f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:02 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Volume 8cf06879-8389-4be0-a6b5-461940517653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cf06879-8389-4be0-a6b5-461940517653', 'volume_size': 1}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:02 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD" returned: 0 in 1.152s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Temporary image f11dd628-d05d-412e-b4ef-be70c4399345 is fetched for user 6e6fa186486f4f0fa8d8b579bd3154c0. {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 17 05:33:02 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d" returned: 0 in 2.489s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0235f439-cc38-4982-a036-6a1267693347]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e431bbb6-88c4-4425-b584-7f4ba09e66eb]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:02 devstack sudo[88486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD
Apr 17 05:33:02 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:02 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050
Apr 17 05:33:02 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:02 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:02 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050" returned: 0 in 0.586s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:33:02 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Converted 1024.00 MB image at 411.16 MB/s
Apr 17 05:33:02 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d is being set with open permissions: ugo+rw
Apr 17 05:33:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:02 devstack sudo[88496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d
Apr 17 05:33:02 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:03 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d" returned: 0 in 0.413s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-ed940eb8-3057-4db8-b730-a8c513c5a54d" released by "_copy_volume_from_snapshot" :: held 4.599s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-bfda20e2-46ac-4497-be38-71aba2e92541-ed940eb8-3057-4db8-b730-a8c513c5a54d" released by "_create_volume_from_snapshot" :: held 4.628s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.666s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.614s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Creating offline snapshot 2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 of volume 83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fec0e6-ee05-4c08-8675-3f50668759f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed940eb8-3057-4db8-b730-a8c513c5a54d', 'volume_size': 1, 'snapshot_id': 'bfda20e2-46ac-4497-be38-71aba2e92541'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784a3dda-d2b8-4313-ab46-e816026b095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6389895a-1735-47e5-bc86-3ee54a7eaf6f]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:03 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Volume volume-ed940eb8-3057-4db8-b730-a8c513c5a54d (ed940eb8-3057-4db8-b730-a8c513c5a54d): created successfully
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784a3dda-d2b8-4313-ab46-e816026b095a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Flow 'volume_create_manager' (3e0a73d3-208a-4e43-be89-1101d3828c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:03 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9ce06017-09dc-4a33-af89-9224ce2bba98 tempest-SnapshotDependencyTests-57026698 None] Created volume successfully.
Apr 17 05:33:03 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1
Apr 17 05:33:03 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:03 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1" returned: 0 in 0.503s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:03 devstack sudo[88538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 1G
Apr 17 05:33:03 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:04 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 1G" returned: 0 in 0.503s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83103005-95e5-410b-b0da-64e6b1eb46c1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:04 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83103005-95e5-410b-b0da-64e6b1eb46c1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20
Apr 17 05:33:04 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "cinder-bfda20e2-46ac-4497-be38-71aba2e92541-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-bfda20e2-46ac-4497-be38-71aba2e92541-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "cinder-quobyte-09d449eb-4cad-4feb-9200-424f41f0e050" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-09d449eb-4cad-4feb-9200-424f41f0e050" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "cinder-quobyte-bfda20e2-46ac-4497-be38-71aba2e92541" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-bfda20e2-46ac-4497-be38-71aba2e92541" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Deleting offline snapshot bfda20e2-46ac-4497-be38-71aba2e92541 of volume 09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] snapshot_file for this snap is: volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a467fdb4-a770-49b7-a038-8238bfb84ba4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:04 devstack sudo[88546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541
Apr 17 05:33:04 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:04 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83103005-95e5-410b-b0da-64e6b1eb46c1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20" returned: 0 in 0.464s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:04 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 is being set with open permissions: ugo+rw
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:04 devstack sudo[88551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20
Apr 17 05:33:04 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:04 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541" returned: 0 in 0.469s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09d449eb-4cad-4feb-9200-424f41f0e050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[081f59ba-bf5b-47a1-b23a-206a73bcece4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:04 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050
Apr 17 05:33:04 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:05 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20" returned: 0 in 0.423s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:05 devstack sudo[88559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.info
Apr 17 05:33:05 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:05 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050" returned: 0 in 0.509s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:05 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541
Apr 17 05:33:05 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:05 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.info" returned: 0 in 0.463s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:05 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.info is being set with open permissions: ugo+rw
Apr 17 05:33:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:05 devstack sudo[88567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.info
Apr 17 05:33:05 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:05 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541" returned: 0 in 0.474s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:05 devstack sudo[88572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541
Apr 17 05:33:05 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:06 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.info" returned: 0 in 0.413s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.843s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.987s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-903711355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf06879-8389-4be0-a6b5-461940517653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:02Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Creating volume 8cf06879-8389-4be0-a6b5-461940517653 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:06 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:06 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653 1073741824
Apr 17 05:33:06 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-206c8c2b-c23c-4a1f-b8f3-07d859e705b3 tempest-VolumesSnapshotListTestJSON-325166181 None] Create snapshot completed successfully
Apr 17 05:33:06 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050.bfda20e2-46ac-4497-be38-71aba2e92541" returned: 0 in 0.419s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-bfda20e2-46ac-4497-be38-71aba2e92541" released by "_delete_snapshot" :: held 1.921s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-09d449eb-4cad-4feb-9200-424f41f0e050" released by "delete_snapshot" :: held 1.934s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Created reservations ['f940a245-a00e-442b-bcfb-cac159bf1db1', '9be61369-3574-4f2f-b65a-a5bc2247bf64', '16a8f4b7-9627-47e0-a5b8-7a918a9d3a04', '1a079659-1a70-4cfa-990a-62aabe32f94e'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Delete snapshot completed successfully.
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0edef9a9-1954-492f-8af7-e5a60e105395 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-bfda20e2-46ac-4497-be38-71aba2e92541-delete_snapshot" released by "delete_snapshot" :: held 2.026s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "cinder-09d449eb-4cad-4feb-9200-424f41f0e050-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-09d449eb-4cad-4feb-9200-424f41f0e050-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "cinder-quobyte-09d449eb-4cad-4feb-9200-424f41f0e050" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-09d449eb-4cad-4feb-9200-424f41f0e050" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:06 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653 1073741824" returned: 0 in 0.526s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b99846-4d43-4896-a1b1-472f2606ce66]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:06 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653
Apr 17 05:33:06 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:06 devstack sudo[88581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050
Apr 17 05:33:06 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:07 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653" returned: 0 in 0.453s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.457s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-826535991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85e6aa4-249f-4188-982d-741b02539371,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:00Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Creating volume e85e6aa4-249f-4188-982d-741b02539371 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:07 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:07 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83dc6f85-eedd-4025-bb8e-a81888da4f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf06879-8389-4be0-a6b5-461940517653', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c7d307-eb9c-4f1a-9098-3d2737e0e936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:07 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 1073741824
Apr 17 05:33:07 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050" returned: 0 in 0.523s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:07 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Volume volume-8cf06879-8389-4be0-a6b5-461940517653 (8cf06879-8389-4be0-a6b5-461940517653): created successfully
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c7d307-eb9c-4f1a-9098-3d2737e0e936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (294e8fa5-40b1-4cc2-af2e-b7b2aadd7981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:07 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050
Apr 17 05:33:07 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:07 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dced4258-b478-4c94-8975-8504dbcfd2bb tempest-VolumesActionsTest-1224148691 None] Created volume successfully.
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Acquiring lock "cinder-8cf06879-8389-4be0-a6b5-461940517653-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Lock "cinder-8cf06879-8389-4be0-a6b5-461940517653-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:07 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-09d449eb-4cad-4feb-9200-424f41f0e050" returned: 0 in 0.440s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Acquiring lock "cinder-quobyte-8cf06879-8389-4be0-a6b5-461940517653" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-09d449eb-4cad-4feb-9200-424f41f0e050" released by "delete_volume" :: held 1.001s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Lock "cinder-quobyte-8cf06879-8389-4be0-a6b5-461940517653" acquired by "delete_volume" :: waited 0.020s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[838b52c3-6511-4218-a5a3-1b4696924a89]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:07 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 1073741824" returned: 0 in 0.553s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Created reservations ['c6429a43-1a29-4639-bdd6-4210ca9d5d6c', 'ad3c19d3-406c-45ed-b2d6-d5729f45d5f7', 'c21720a6-1e3d-42f5-8fb2-5ea670b87b06', 'b55343c8-b0c5-445f-b76a-55168031d7ed'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:07 devstack sudo[88598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653
Apr 17 05:33:07 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:07 devstack sudo[88599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371
Apr 17 05:33:07 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:07 devstack sudo[88602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:07 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:08 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371" returned: 0 in 0.410s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:08 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.106s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653" returned: 0 in 0.495s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] Creating offline snapshot f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd of volume 83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:33:08 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653
Apr 17 05:33:08 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[02094ebf-9199-4e46-a549-d9701f0a8a3b]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Attempting download of f11dd628-d05d-412e-b4ef-be70c4399345 ((None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}])) to volume e85e6aa4-249f-4188-982d-741b02539371. {{(pid=82266) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 17 05:33:08 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.458s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:08 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Deleted volume successfully.
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-81b33207-3ca9-4417-8ef4-9e624026d1fd tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-09d449eb-4cad-4feb-9200-424f41f0e050-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9542ab-2b85-42a4-8cca-2dfc7a1cd18c]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_bswbs8fv {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:08 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20
Apr 17 05:33:08 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:08 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_bswbs8fv
Apr 17 05:33:08 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:08 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8cf06879-8389-4be0-a6b5-461940517653" returned: 0 in 0.425s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Lock "cinder-quobyte-8cf06879-8389-4be0-a6b5-461940517653" released by "delete_volume" :: held 0.946s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Created reservations ['97cfa5ae-97ef-48a7-9d0e-40fc869072ec', '7040f054-032c-487a-a38f-c51e4b36dfa9', '21954f57-fce7-4f5d-86f8-c57e8743feb8', '2e81a5ee-ed2d-4a07-990a-593f6676938d'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:08 devstack sudo[88621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:08 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:08 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20" returned: 0 in 0.532s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83103005-95e5-410b-b0da-64e6b1eb46c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:08 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_bswbs8fv" returned: 0 in 0.491s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_bswbs8fv {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:08 devstack sudo[88623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd 1G
Apr 17 05:33:08 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "cinder-ed940eb8-3057-4db8-b730-a8c513c5a54d-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-ed940eb8-3057-4db8-b730-a8c513c5a54d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "cinder-quobyte-ed940eb8-3057-4db8-b730-a8c513c5a54d" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-ed940eb8-3057-4db8-b730-a8c513c5a54d" acquired by "delete_volume" :: waited 0.017s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:08 devstack sudo[88624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_bswbs8fv
Apr 17 05:33:08 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2b3872-a1a7-4d1c-a898-3c2429aac5a1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:08 devstack sudo[88627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d
Apr 17 05:33:08 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (a85e10ef-ea33-422d-9b0e-5d9ad97779ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475f09d1-8e60-44b9-86c9-5745317f1491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475f09d1-8e60-44b9-86c9-5745317f1491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-226077582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e591559d-493d-47aa-b2f2-a5a92ddbef8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:09Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01624f7e-82b6-4c4c-839c-798bc173f68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01624f7e-82b6-4c4c-839c-798bc173f68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c838680e-9e6f-4839-b9f8-ee7cafff71ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c838680e-9e6f-4839-b9f8-ee7cafff71ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e591559d-493d-47aa-b2f2-a5a92ddbef8a', 'volume_name': 'volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045b1fc1-9227-4280-90dd-90745eda41f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045b1fc1-9227-4280-90dd-90745eda41f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa08f1bd-a72a-4e57-b303-0f22962cef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:09 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Volume e591559d-493d-47aa-b2f2-a5a92ddbef8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a', 'volume_size': 1}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:09 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.574s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:09 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Deleted volume successfully.
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-af974641-e1b5-4395-8dcb-d21e9918878d tempest-VolumesActionsTest-451619735 None] Lock "cinder-8cf06879-8389-4be0-a6b5-461940517653-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:09 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd 1G" returned: 0 in 0.664s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:09 devstack sudo[88638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd
Apr 17 05:33:09 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:09 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_bswbs8fv" returned: 1 in 0.687s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11dd628-d05d-412e-b4ef-be70c4399345_bswbs8fv' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:33:09 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c8749b-6375-4b1d-83f8-4cb81979bf25]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d" returned: 0 in 0.564s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:09 devstack sudo[88641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d
Apr 17 05:33:09 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:09 devstack sudo[88640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD
Apr 17 05:33:09 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:09 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd" returned: 0 in 0.444s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:09 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd is being set with open permissions: ugo+rw
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:09 devstack sudo[88651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd
Apr 17 05:33:09 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:09 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ed940eb8-3057-4db8-b730-a8c513c5a54d" returned: 0 in 0.426s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-quobyte-ed940eb8-3057-4db8-b730-a8c513c5a54d" released by "delete_volume" :: held 1.019s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:09 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] f11dd628-d05d-412e-b4ef-be70c4399345 was qcow2, converting to raw {{(pid=82266) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Created reservations ['ab33851b-e449-4f8f-96c4-e477d47f25a7', 'fa8a3c1b-b750-4b8e-a318-7a1fb2ee64ed', 'fa4c3c61-ec94-409b-b9b4-6c4636ce66a6', '95bae626-eb31-426a-abfc-00eb226bba25'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:09 devstack sudo[88653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371
Apr 17 05:33:09 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:09 devstack sudo[88655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:09 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:10 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd" returned: 0 in 0.436s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.066s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-226077582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e591559d-493d-47aa-b2f2-a5a92ddbef8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84342e1004fdf9dc00603d2e50c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:09Z,use_quota=True,user_id='7cc92b227a724b31a74c7ddc5c23dc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Creating volume e591559d-493d-47aa-b2f2-a5a92ddbef8a {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:10 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:10 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-194ab35c-b221-49ff-9aaa-4f0821ff213c tempest-VolumesSnapshotListTestJSON-325166181 None] Create snapshot completed successfully
Apr 17 05:33:10 devstack sudo[88672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a 1073741824
Apr 17 05:33:10 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:10 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.490s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:10 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Deleted volume successfully.
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d95341ca-9b8a-452b-95d8-f0f19528d563 tempest-SnapshotDependencyTests-57026698 None] Lock "cinder-ed940eb8-3057-4db8-b730-a8c513c5a54d-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:10 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371" returned: 0 in 0.891s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f11dd628-d05d-412e-b4ef-be70c4399345_zh52u_6cdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:33:10 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Converted 112.00 MB image at 112.00 MB/s
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:10 devstack sudo[88678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 1G
Apr 17 05:33:10 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:10 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a 1073741824" returned: 0 in 0.590s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:10 devstack sudo[88680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a
Apr 17 05:33:10 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:11 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 1G" returned: 0 in 0.512s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[08736e7d-b57e-4aaa-97a0-6c7704f2a99e]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:11 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a" returned: 0 in 0.474s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.091s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:11 devstack sudo[88686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371
Apr 17 05:33:11 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa08f1bd-a72a-4e57-b303-0f22962cef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dacce78-03a4-4e16-b1e2-25590236d1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] Creating offline snapshot 9f220041-b7b2-4b30-a1db-6b61d18cb03f of volume 83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:33:11 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Volume volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a (e591559d-493d-47aa-b2f2-a5a92ddbef8a): created successfully
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dacce78-03a4-4e16-b1e2-25590236d1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Flow 'volume_create_manager' (a85e10ef-ea33-422d-9b0e-5d9ad97779ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eb6868-70ab-4980-b8ef-0f644bf4d589]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:11 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7d5c0915-bc26-4888-8668-95b792bd7edd tempest-VolumesActionsTest-1224148691 None] Created volume successfully.
Apr 17 05:33:11 devstack sudo[88688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd
Apr 17 05:33:11 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:11 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371" returned: 0 in 0.513s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:11 devstack sudo[88692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371
Apr 17 05:33:11 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:11 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd" returned: 0 in 0.487s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83103005-95e5-410b-b0da-64e6b1eb46c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:33:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:11 devstack sudo[88697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f 1G
Apr 17 05:33:11 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:12 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371" returned: 1 in 0.598s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Downloaded image f11dd628-d05d-412e-b4ef-be70c4399345 ((None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}])) to volume e85e6aa4-249f-4188-982d-741b02539371 successfully. {{(pid=82266) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Temporary image f11dd628-d05d-412e-b4ef-be70c4399345 for user 6e6fa186486f4f0fa8d8b579bd3154c0 is deleted. {{(pid=82266) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.volume.volume_utils [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Marking volume e85e6aa4-249f-4188-982d-741b02539371 as bootable. {{(pid=82266) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Copying metadata from image f11dd628-d05d-412e-b4ef-be70c4399345 to e85e6aa4-249f-4188-982d-741b02539371. {{(pid=82266) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Creating volume glance metadata for volume e85e6aa4-249f-4188-982d-741b02539371 backed by image f11dd628-d05d-412e-b4ef-be70c4399345 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82266) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb885acb-f534-4c3f-b226-67dba3669e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85e6aa4-249f-4188-982d-741b02539371', 'volume_size': 1, 'image_id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11dd628-d05d-412e-b4ef-be70c4399345', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'beda2037843a4bc59d79d6f3ae3fdea7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f11dd628-d05d-412e-b4ef-be70c4399345', 'created_at': datetime.datetime(2026, 4, 17, 3, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11dd628-d05d-412e-b4ef-be70c4399345/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f536d8cec50>}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eae8575-6e58-4b62-9c83-b8d11ee44c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:12 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Volume volume-e85e6aa4-249f-4188-982d-741b02539371 (e85e6aa4-249f-4188-982d-741b02539371): created successfully
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eae8575-6e58-4b62-9c83-b8d11ee44c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (29839f86-57b7-48bb-8a1c-5b314803946a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:12 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f 1G" returned: 0 in 0.589s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:12 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4408122e-9c60-4813-b779-0e46dde2dd9f tempest-VolumesGetTest-490539219 None] Created volume successfully.
Apr 17 05:33:12 devstack sudo[88706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f
Apr 17 05:33:12 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "cinder-e591559d-493d-47aa-b2f2-a5a92ddbef8a-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Lock "cinder-e591559d-493d-47aa-b2f2-a5a92ddbef8a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "cinder-quobyte-e591559d-493d-47aa-b2f2-a5a92ddbef8a" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Lock "cinder-quobyte-e591559d-493d-47aa-b2f2-a5a92ddbef8a" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13428ce-6858-4863-921a-8ef3d0056842]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:13 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f" returned: 0 in 0.524s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:13 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f is being set with open permissions: ugo+rw
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:13 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a
Apr 17 05:33:13 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:13 devstack sudo[88712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f
Apr 17 05:33:13 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (2f798c0e-85b8-45b9-a829-4a90749756fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd68e7c8-2ec4-4e0c-ad2e-e14cc86eb5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd68e7c8-2ec4-4e0c-ad2e-e14cc86eb5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-819714465',display_name='tempest-VolumesGetTest-Volume-1943158511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1212c4-792a-4025-8cc7-c1747c3bbbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:13Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a07d74-ce98-477e-9195-b9189872f8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a07d74-ce98-477e-9195-b9189872f8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6bd2947-e167-43e5-88f9-208ca1c41b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6bd2947-e167-43e5-88f9-208ca1c41b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1212c4-792a-4025-8cc7-c1747c3bbbd6', 'volume_name': 'volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8e58e2-94e6-427f-9933-54d889ee4e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8e58e2-94e6-427f-9933-54d889ee4e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f97e8ca-5ce3-4547-99d5-60f488e81529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:13 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Volume 0c1212c4-792a-4025-8cc7-c1747c3bbbd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6', 'volume_size': 1}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:13 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a" returned: 0 in 0.612s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:13 devstack sudo[88719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a
Apr 17 05:33:13 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:13 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f" returned: 0 in 0.574s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-819714465',display_name='tempest-VolumesGetTest-Volume-1943158511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1212c4-792a-4025-8cc7-c1747c3bbbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085d53cfaa914ad58b1c4a171c882db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:13Z,use_quota=True,user_id='6e6fa186486f4f0fa8d8b579bd3154c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Creating volume 0c1212c4-792a-4025-8cc7-c1747c3bbbd6 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:13 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:13 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6 1073741824
Apr 17 05:33:13 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:13 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5d247a2f-eb66-4773-a0ad-d67146836953 tempest-VolumesSnapshotListTestJSON-325166181 None] Create snapshot completed successfully
Apr 17 05:33:13 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e591559d-493d-47aa-b2f2-a5a92ddbef8a" returned: 0 in 0.480s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Lock "cinder-quobyte-e591559d-493d-47aa-b2f2-a5a92ddbef8a" released by "delete_volume" :: held 1.116s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:13 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Created reservations ['38d0cd24-2fb7-42ee-aef2-c9427a279a84', '01a9cbe7-a9ab-44e1-9220-26ec4b0e116c', '54a5e729-379b-441c-a3c3-07f43bb705be', '38b78dec-702d-4f17-92b9-8a4ca3cfcc4f'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:14 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:14 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:14 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6 1073741824" returned: 0 in 0.593s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:14 devstack sudo[88730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6
Apr 17 05:33:14 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:14 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.532s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Deleted volume successfully.
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-63116f64-f963-4d59-acd9-2fa96b49a640 tempest-VolumesActionsTest-1224148691 None] Lock "cinder-e591559d-493d-47aa-b2f2-a5a92ddbef8a-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:14 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6" returned: 0 in 0.488s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f97e8ca-5ce3-4547-99d5-60f488e81529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56313ec-6cc9-4067-a667-7106b6c5710a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:14 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Volume volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6 (0c1212c4-792a-4025-8cc7-c1747c3bbbd6): created successfully
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56313ec-6cc9-4067-a667-7106b6c5710a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Flow 'volume_create_manager' (2f798c0e-85b8-45b9-a829-4a90749756fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5e107ee6-58b4-4940-8b24-28ce5fe5549c tempest-VolumesGetTest-490539219 None] Created volume successfully.
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-9f220041-b7b2-4b30-a1db-6b61d18cb03f-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-9f220041-b7b2-4b30-a1db-6b61d18cb03f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-quobyte-9f220041-b7b2-4b30-a1db-6b61d18cb03f" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-9f220041-b7b2-4b30-a1db-6b61d18cb03f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Deleting offline snapshot 9f220041-b7b2-4b30-a1db-6b61d18cb03f of volume 83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] snapshot_file for this snap is: volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b651639b-78db-4b04-b1c9-57d0850eaafb]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:15 devstack sudo[88735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f
Apr 17 05:33:15 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-0c1212c4-792a-4025-8cc7-c1747c3bbbd6-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Lock "cinder-0c1212c4-792a-4025-8cc7-c1747c3bbbd6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-quobyte-0c1212c4-792a-4025-8cc7-c1747c3bbbd6" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-0c1212c4-792a-4025-8cc7-c1747c3bbbd6" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[513686a6-6ed0-43c8-8232-939258fe697a]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:15 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6
Apr 17 05:33:15 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:15 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f" returned: 0 in 0.772s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83103005-95e5-410b-b0da-64e6b1eb46c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3144bdc4-fef3-4ebe-884c-7fa9a69260ca]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:15 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd
Apr 17 05:33:15 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:16 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6" returned: 0 in 0.623s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:16 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6
Apr 17 05:33:16 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:16 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd" returned: 0 in 0.657s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83103005-95e5-410b-b0da-64e6b1eb46c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:16 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f
Apr 17 05:33:16 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:16 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-0c1212c4-792a-4025-8cc7-c1747c3bbbd6" returned: 0 in 0.582s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-0c1212c4-792a-4025-8cc7-c1747c3bbbd6" released by "delete_volume" :: held 1.229s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Created reservations ['cb024c84-d7ee-4956-875a-96ee3b8a90df', 'dc42f31f-624f-4079-a0ac-caaf4d9cee9b', '26fffccf-c264-44df-8c78-d503ee532aad', '6e0ecde7-99e0-4d03-9ae2-0c88f2135327'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:16 devstack sudo[88757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:16 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:17 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f" returned: 0 in 0.624s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:17 devstack sudo[88763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f
Apr 17 05:33:17 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:17 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.550s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:17 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Deleted volume successfully.
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5fa7bcbc-1d7a-4614-a799-3526186b254e tempest-VolumesGetTest-490539219 None] Lock "cinder-0c1212c4-792a-4025-8cc7-c1747c3bbbd6-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-e85e6aa4-249f-4188-982d-741b02539371-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Lock "cinder-e85e6aa4-249f-4188-982d-741b02539371-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:17 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.9f220041-b7b2-4b30-a1db-6b61d18cb03f" returned: 0 in 0.574s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-9f220041-b7b2-4b30-a1db-6b61d18cb03f" released by "_delete_snapshot" :: held 2.706s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Acquiring lock "cinder-quobyte-e85e6aa4-249f-4188-982d-741b02539371" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" released by "delete_snapshot" :: held 2.721s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-e85e6aa4-249f-4188-982d-741b02539371" acquired by "delete_volume" :: waited 0.027s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Created reservations ['95f7d9ea-38aa-4209-9653-88c0e2caace7', '0e2ab63e-1b5a-426e-a957-107c83915a18', '146a45fe-cfa3-4d95-9904-4eb7d2b75c89', '799e0afe-560b-4e8a-a5a7-e1787720f51c'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b06fb-2aa8-4c11-a4c9-0279a8dc74c7]: (4, 'raw') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:17 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Delete snapshot completed successfully.
Apr 17 05:33:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-79d790ae-1adf-481c-ad03-349c71634895 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-9f220041-b7b2-4b30-a1db-6b61d18cb03f-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:17 devstack sudo[88767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371
Apr 17 05:33:17 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-quobyte-f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Deleting offline snapshot f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd of volume 83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] snapshot_file for this snap is: volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[637719e4-66d3-4b1c-b693-5e5132d75470]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:18 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd
Apr 17 05:33:18 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:18 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371" returned: 0 in 0.597s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:18 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371
Apr 17 05:33:18 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:18 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd" returned: 0 in 0.521s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83103005-95e5-410b-b0da-64e6b1eb46c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c0a3e7-49bc-4d17-8c62-64fcdcefd3fa]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:18 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20
Apr 17 05:33:18 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:18 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371" returned: 1 in 0.508s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371' failed. Not Retrying. {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 17 05:33:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:18 devstack sudo[88784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371
Apr 17 05:33:18 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:19 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20" returned: 0 in 0.518s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83103005-95e5-410b-b0da-64e6b1eb46c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:19 devstack sudo[88790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd
Apr 17 05:33:19 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:19 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-e85e6aa4-249f-4188-982d-741b02539371" returned: 0 in 0.444s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Lock "cinder-quobyte-e85e6aa4-249f-4188-982d-741b02539371" released by "delete_volume" :: held 1.604s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Created reservations ['66c5e592-9b84-49eb-ab64-b3182ce0dc78', '83771b31-b270-4e3e-8b9f-d7d44fe4233e', '24828862-e873-4877-89ac-409ce9ee17d7', '404f891a-0542-432e-95a4-022723e30144'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:19 devstack sudo[88793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:19 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:19 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd" returned: 0 in 0.490s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:19 devstack sudo[88798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd
Apr 17 05:33:19 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:19 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.452s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:19 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Deleted volume successfully.
Apr 17 05:33:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6f232a7e-1e6f-456f-9821-4d4733911938 tempest-VolumesGetTest-490539219 None] Lock "cinder-e85e6aa4-249f-4188-982d-741b02539371-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:20 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd" returned: 0 in 0.462s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:20 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd" released by "_delete_snapshot" :: held 2.045s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:20 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" released by "delete_snapshot" :: held 2.057s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:20 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Created reservations ['3b2b68e1-59cd-4ea1-a822-333ab54a416b', '5396a7bc-3a45-48fb-92c2-d40ff23638c3', '8e5af1a5-b4c6-4689-b0ae-ec89aa3ca6b7', '66351483-8c84-4717-a4ab-46e9fc87012a'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:20 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Delete snapshot completed successfully.
Apr 17 05:33:20 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8ae31ed1-babd-4ab5-ab10-52792ece6461 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-f5fe9f25-cdf4-4cb1-9a39-4287868b5cbd-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-quobyte-2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Deleting offline snapshot 2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 of volume 83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] snapshot_file for this snap is: volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[27613437-c6a4-4b3d-bb81-ba7531bbb636]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:21 devstack sudo[88803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20
Apr 17 05:33:21 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Flow 'volume_create_manager' (af59628c-8761-430a-990c-8a589808eba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1251cb2f-31fe-47e5-b9cf-b250d74dfefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1251cb2f-31fe-47e5-b9cf-b250d74dfefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced4af55-c392-4f9e-b0e0-ccf7d531be24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759879241a0245238763f76ecfd43ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:22Z,use_quota=True,user_id='0dfbe0ee85924be3bff5c5dff393fd9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4cfa13-c453-4fc0-ade4-96f5855a36c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4cfa13-c453-4fc0-ade4-96f5855a36c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31ba588-bc37-4b1e-9796-91cca5fe7786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31ba588-bc37-4b1e-9796-91cca5fe7786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced4af55-c392-4f9e-b0e0-ccf7d531be24', 'volume_name': 'volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d3ed1e-8619-41ec-81f1-5ede25ed7920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d3ed1e-8619-41ec-81f1-5ede25ed7920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78412fa8-8070-4af9-84da-0fd54b76a0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:21 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Volume ced4af55-c392-4f9e-b0e0-ccf7d531be24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24', 'volume_size': 1}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced4af55-c392-4f9e-b0e0-ccf7d531be24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759879241a0245238763f76ecfd43ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:22Z,use_quota=True,user_id='0dfbe0ee85924be3bff5c5dff393fd9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Creating volume ced4af55-c392-4f9e-b0e0-ccf7d531be24 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:21 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:21 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24 1073741824
Apr 17 05:33:21 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:21 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20" returned: 0 in 0.558s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83103005-95e5-410b-b0da-64e6b1eb46c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1bfed7-5da6-4902-b9d2-48cec82f7bfc]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:22 devstack sudo[88811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1
Apr 17 05:33:22 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:22 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24 1073741824" returned: 0 in 0.504s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:22 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24
Apr 17 05:33:22 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:22 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1" returned: 0 in 0.554s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:22 devstack sudo[88821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20
Apr 17 05:33:22 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:22 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24" returned: 0 in 0.444s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78412fa8-8070-4af9-84da-0fd54b76a0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209addf3-0667-48ac-8eb2-c8419c2292b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:22 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Volume volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24 (ced4af55-c392-4f9e-b0e0-ccf7d531be24): created successfully
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209addf3-0667-48ac-8eb2-c8419c2292b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Flow 'volume_create_manager' (af59628c-8761-430a-990c-8a589808eba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:22 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ea49724c-7007-49d5-a916-07065f1b7742 tempest-CinderUnicodeTest-602004432 None] Created volume successfully.
Apr 17 05:33:23 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20" returned: 0 in 0.510s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:23 devstack sudo[88827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20
Apr 17 05:33:23 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:23 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1.2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20" released by "_delete_snapshot" :: held 2.166s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" released by "delete_snapshot" :: held 2.182s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Flow 'volume_create_manager' (0bc40379-0b73-4bf8-b740-3f6f4a1b1d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3259aa-e491-4ef0-9a1a-ad5b45a2c7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Created reservations ['5ebe2cf8-af35-466d-b451-a7294c9910ad', 'b5a4b268-42ad-479a-a3ce-ee700835334e', 'd3df90ad-c1d2-40fe-a42e-d1a6a1803d2f', 'd604d102-a997-4224-932d-a333fd3ef208'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3259aa-e491-4ef0-9a1a-ad5b45a2c7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-434867587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b382776-75a2-4287-95a2-e27a4fae9099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7617cbfa7d5465fb77ab9c40a2037f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:24Z,use_quota=True,user_id='4e7d23cb06224ac9a07ba4c492dde174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5a3ca3-9ada-4394-9ecc-2463cbb26aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5a3ca3-9ada-4394-9ecc-2463cbb26aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5188c5-88f5-4b2f-961c-32704d0ddcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5188c5-88f5-4b2f-961c-32704d0ddcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b382776-75a2-4287-95a2-e27a4fae9099', 'volume_name': 'volume-1b382776-75a2-4287-95a2-e27a4fae9099', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87a170d-3f6f-47a5-be3b-22c4240c0694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87a170d-3f6f-47a5-be3b-22c4240c0694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb64ef60-339c-4b2a-8023-8b81f9135088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:23 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Volume 1b382776-75a2-4287-95a2-e27a4fae9099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b382776-75a2-4287-95a2-e27a4fae9099', 'volume_size': 1}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-434867587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b382776-75a2-4287-95a2-e27a4fae9099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7617cbfa7d5465fb77ab9c40a2037f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:24Z,use_quota=True,user_id='4e7d23cb06224ac9a07ba4c492dde174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Creating volume 1b382776-75a2-4287-95a2-e27a4fae9099 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:23 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:23 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099 1073741824
Apr 17 05:33:23 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:23 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Delete snapshot completed successfully.
Apr 17 05:33:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e66beb1e-d2af-4dd1-a54d-795479c6922d tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-2e1fc276-b4af-4c1a-b7ca-d1f3d0977b20-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Flow 'volume_create_manager' (85dea1f9-c58d-415a-b094-955c96571a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804aec40-acc2-4b2a-b74e-fc064b441e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:24 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099 1073741824" returned: 0 in 0.543s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804aec40-acc2-4b2a-b74e-fc064b441e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1845423684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981303f4-d048-4147-8546-2aed8faa4b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759879241a0245238763f76ecfd43ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:24Z,use_quota=True,user_id='0dfbe0ee85924be3bff5c5dff393fd9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bfe7d2-c245-4fc3-ab49-55b08e70a117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bfe7d2-c245-4fc3-ab49-55b08e70a117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354299c2-7d87-4407-bc66-f1b85ef4d256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354299c2-7d87-4407-bc66-f1b85ef4d256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981303f4-d048-4147-8546-2aed8faa4b1f', 'volume_name': 'volume-981303f4-d048-4147-8546-2aed8faa4b1f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca17445-0a0b-4cd4-b28a-ef3535079189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca17445-0a0b-4cd4-b28a-ef3535079189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d37577e-3dce-4a06-ab19-12f2f995f180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:24 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Volume 981303f4-d048-4147-8546-2aed8faa4b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981303f4-d048-4147-8546-2aed8faa4b1f', 'volume_size': 1}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:24 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099
Apr 17 05:33:24 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-83103005-95e5-410b-b0da-64e6b1eb46c1-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-83103005-95e5-410b-b0da-64e6b1eb46c1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d79d3c-22ad-402c-a8d9-65a7bc7a55ba]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:24 devstack sudo[88838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1
Apr 17 05:33:24 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:24 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099" returned: 0 in 0.428s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1845423684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981303f4-d048-4147-8546-2aed8faa4b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759879241a0245238763f76ecfd43ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:24Z,use_quota=True,user_id='0dfbe0ee85924be3bff5c5dff393fd9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Creating volume 981303f4-d048-4147-8546-2aed8faa4b1f {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:24 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb64ef60-339c-4b2a-8023-8b81f9135088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b382776-75a2-4287-95a2-e27a4fae9099', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:24 devstack sudo[88840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f 1073741824
Apr 17 05:33:24 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b17393-05c1-4731-b4c5-f250ddf9ecd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:24 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Volume volume-1b382776-75a2-4287-95a2-e27a4fae9099 (1b382776-75a2-4287-95a2-e27a4fae9099): created successfully
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b17393-05c1-4731-b4c5-f250ddf9ecd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Flow 'volume_create_manager' (0bc40379-0b73-4bf8-b740-3f6f4a1b1d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:24 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-53ff6cae-fb9a-4f68-858d-447a6795e43a tempest-VolumesTransfersTest-1456424680 None] Created volume successfully.
Apr 17 05:33:25 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1" returned: 0 in 0.469s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:25 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1
Apr 17 05:33:25 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:25 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f 1073741824" returned: 0 in 0.512s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:25 devstack sudo[88850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f
Apr 17 05:33:25 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:25 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-83103005-95e5-410b-b0da-64e6b1eb46c1" returned: 0 in 0.440s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-quobyte-83103005-95e5-410b-b0da-64e6b1eb46c1" released by "delete_volume" :: held 0.940s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Created reservations ['2d03abee-4c43-44cc-82ab-f84dfc90ec3e', 'b7baa75a-3449-43bf-bda8-c8aaf674bcf9', '9030de4e-a1e6-433e-b1ca-d5268dfe8a32', 'da8bb4f2-7d10-4f9b-a749-b6115127fc28'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:25 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:25 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:25 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f" returned: 0 in 0.424s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d37577e-3dce-4a06-ab19-12f2f995f180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981303f4-d048-4147-8546-2aed8faa4b1f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03185900-4aad-484e-8e1a-4e5a7552d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:25 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Volume volume-981303f4-d048-4147-8546-2aed8faa4b1f (981303f4-d048-4147-8546-2aed8faa4b1f): created successfully
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03185900-4aad-484e-8e1a-4e5a7552d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Flow 'volume_create_manager' (85dea1f9-c58d-415a-b094-955c96571a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:25 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a18a92c4-fa03-4a43-8518-ec40eb6a6022 tempest-CinderUnicodeTest-602004432 None] Created volume successfully.
Apr 17 05:33:26 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.504s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:26 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:26 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Deleted volume successfully.
Apr 17 05:33:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-a6dd1475-71e8-45e9-90a2-f12508529f42 tempest-VolumesSnapshotListTestJSON-325166181 None] Lock "cinder-83103005-95e5-410b-b0da-64e6b1eb46c1-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:26 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a0a8790c-2422-4210-9480-3fc515f9c0ac tempest-VolumesTransfersTest-1330107772 None] Transfer volume completed successfully.
Apr 17 05:33:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Creating offline snapshot 30df27e0-a585-4217-8c65-e34e4462ff1d of volume 981303f4-d048-4147-8546-2aed8faa4b1f {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:33:26 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6db474-2f8a-45ec-9382-e6e81ff893f5]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:26 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f
Apr 17 05:33:26 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:27 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f" returned: 0 in 0.510s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:27 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d 1G
Apr 17 05:33:27 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Acquiring lock "cinder-1b382776-75a2-4287-95a2-e27a4fae9099-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Lock "cinder-1b382776-75a2-4287-95a2-e27a4fae9099-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Acquiring lock "cinder-quobyte-1b382776-75a2-4287-95a2-e27a4fae9099" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Lock "cinder-quobyte-1b382776-75a2-4287-95a2-e27a4fae9099" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2beedb-2670-4e3c-9c1e-158ff7082c5c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:27 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099
Apr 17 05:33:27 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:27 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d 1G" returned: 0 in 0.570s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-981303f4-d048-4147-8546-2aed8faa4b1f -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:27 devstack sudo[88870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-981303f4-d048-4147-8546-2aed8faa4b1f -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d
Apr 17 05:33:27 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Flow 'volume_create_manager' (99c0a71b-6251-4e88-94a9-80658c495754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bd3244-27ab-42e2-81c9-3c93eecb59ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bd3244-27ab-42e2-81c9-3c93eecb59ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1912332601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e4a981-44b1-447a-9004-77cdc37ac21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa276469d00043ca889564b50dc21e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:28Z,use_quota=True,user_id='ba10d39073d645a5bf44a1bfeee54b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b0baa9-920b-4267-85f1-230e3115093f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b0baa9-920b-4267-85f1-230e3115093f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664c0c31-7824-4800-8648-9119e82849fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664c0c31-7824-4800-8648-9119e82849fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e4a981-44b1-447a-9004-77cdc37ac21c', 'volume_name': 'volume-52e4a981-44b1-447a-9004-77cdc37ac21c', 'volume_size': 2}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79602047-9e25-4b1f-be41-94fddd988593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79602047-9e25-4b1f-be41-94fddd988593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee090f5-b819-4c78-a82a-07b4f5f7abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:27 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Volume 52e4a981-44b1-447a-9004-77cdc37ac21c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e4a981-44b1-447a-9004-77cdc37ac21c', 'volume_size': 2}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:27 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099" returned: 0 in 0.541s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:27 devstack sudo[88875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099
Apr 17 05:33:27 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:28 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-981303f4-d048-4147-8546-2aed8faa4b1f -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d" returned: 0 in 0.444s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:28 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d is being set with open permissions: ugo+rw
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:28 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d
Apr 17 05:33:28 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:28 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1b382776-75a2-4287-95a2-e27a4fae9099" returned: 0 in 0.402s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Lock "cinder-quobyte-1b382776-75a2-4287-95a2-e27a4fae9099" released by "delete_volume" :: held 0.973s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Created reservations ['d44ffaf4-a7d7-43ac-9bb4-ed89451e20eb', '16af1b57-ca76-4e04-9dfc-271633d6f08d', 'd7b29700-5023-4aad-a98a-29712da6d775', '4165bc9b-87fa-4bff-a13b-f3a79b72e0a5'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:28 devstack sudo[88883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:28 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Flow 'volume_create_manager' (cc8dc00d-b3a3-455d-b012-bb6e092f3922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5759273-ea47-46a9-8c3a-e8eaa533cda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:28 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5759273-ea47-46a9-8c3a-e8eaa533cda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-300562143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4a8174-8147-4384-a172-8960eaa2ad7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7617cbfa7d5465fb77ab9c40a2037f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:28Z,use_quota=True,user_id='4e7d23cb06224ac9a07ba4c492dde174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb09d693-6d51-4f3d-94df-e28c2f6501a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb09d693-6d51-4f3d-94df-e28c2f6501a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6743b31-6611-4b83-9b06-b87b0095e0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6743b31-6611-4b83-9b06-b87b0095e0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4a8174-8147-4384-a172-8960eaa2ad7f', 'volume_name': 'volume-4d4a8174-8147-4384-a172-8960eaa2ad7f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb17a66-8980-4615-a5db-46377685b1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb17a66-8980-4615-a5db-46377685b1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb415706-5634-44cd-b767-23104951dd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:28 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Volume 4d4a8174-8147-4384-a172-8960eaa2ad7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4a8174-8147-4384-a172-8960eaa2ad7f', 'volume_size': 1}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d" returned: 0 in 0.523s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:28 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.info
Apr 17 05:33:28 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:28 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.452s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:28 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Deleted volume successfully.
Apr 17 05:33:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1c1e8519-41a3-416a-99e7-c63c73b40226 tempest-VolumesTransfersTest-1731950604 None] Lock "cinder-1b382776-75a2-4287-95a2-e27a4fae9099-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:29 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.info" returned: 0 in 0.419s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:29 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.info is being set with open permissions: ugo+rw
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:29 devstack sudo[88890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.info
Apr 17 05:33:29 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:29 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.info" returned: 0 in 0.394s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.914s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.719s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1912332601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e4a981-44b1-447a-9004-77cdc37ac21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa276469d00043ca889564b50dc21e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:28Z,use_quota=True,user_id='ba10d39073d645a5bf44a1bfeee54b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Creating volume 52e4a981-44b1-447a-9004-77cdc37ac21c {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:29 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c 2147483648 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:29 devstack sudo[88893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c 2147483648
Apr 17 05:33:29 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:29 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-6233637f-e431-4eec-baa4-00c1fb7f2b74 tempest-CinderUnicodeTest-602004432 None] Create snapshot completed successfully
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "cinder-30df27e0-a585-4217-8c65-e34e4462ff1d-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-30df27e0-a585-4217-8c65-e34e4462ff1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "cinder-quobyte-981303f4-d048-4147-8546-2aed8faa4b1f" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-quobyte-981303f4-d048-4147-8546-2aed8faa4b1f" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "cinder-quobyte-30df27e0-a585-4217-8c65-e34e4462ff1d" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-quobyte-30df27e0-a585-4217-8c65-e34e4462ff1d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Deleting offline snapshot 30df27e0-a585-4217-8c65-e34e4462ff1d of volume 981303f4-d048-4147-8546-2aed8faa4b1f {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] snapshot_file for this snap is: volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[876fcd7f-7228-4acc-97d2-80ef9b3403ad]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:29 devstack sudo[88895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d
Apr 17 05:33:29 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:29 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c 2147483648" returned: 0 in 0.496s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:29 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c
Apr 17 05:33:29 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:30 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d" returned: 0 in 0.494s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-981303f4-d048-4147-8546-2aed8faa4b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fe7a4c-eb48-4e3c-a416-edfb4b6e8bbb]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:30 devstack sudo[88905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f
Apr 17 05:33:30 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:30 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c" returned: 0 in 0.431s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.808s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-300562143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4a8174-8147-4384-a172-8960eaa2ad7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7617cbfa7d5465fb77ab9c40a2037f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:28Z,use_quota=True,user_id='4e7d23cb06224ac9a07ba4c492dde174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Creating volume 4d4a8174-8147-4384-a172-8960eaa2ad7f {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:30 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee090f5-b819-4c78-a82a-07b4f5f7abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e4a981-44b1-447a-9004-77cdc37ac21c', 'volume_size': 2}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5303cfb8-822a-4cde-bb7b-b70b4afd9067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:30 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f 1073741824
Apr 17 05:33:30 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:30 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Volume volume-52e4a981-44b1-447a-9004-77cdc37ac21c (52e4a981-44b1-447a-9004-77cdc37ac21c): created successfully
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5303cfb8-822a-4cde-bb7b-b70b4afd9067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Flow 'volume_create_manager' (99c0a71b-6251-4e88-94a9-80658c495754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:30 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3099ed69-9f66-4db6-9947-ec2a767af16d tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Created volume successfully.
Apr 17 05:33:30 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f" returned: 0 in 0.466s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:30 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d
Apr 17 05:33:30 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:30 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f 1073741824" returned: 0 in 0.553s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:30 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f
Apr 17 05:33:30 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:31 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d" returned: 0 in 0.486s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:31 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d
Apr 17 05:33:31 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:31 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f" returned: 0 in 0.469s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.507s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb415706-5634-44cd-b767-23104951dd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4a8174-8147-4384-a172-8960eaa2ad7f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4474d9f4-8913-4bad-b5d5-a54141bf9e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Creating offline snapshot 8145b005-537b-42f7-88df-5934fc02f26d of volume 52e4a981-44b1-447a-9004-77cdc37ac21c {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:33:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Volume volume-4d4a8174-8147-4384-a172-8960eaa2ad7f (4d4a8174-8147-4384-a172-8960eaa2ad7f): created successfully
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4474d9f4-8913-4bad-b5d5-a54141bf9e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Flow 'volume_create_manager' (cc8dc00d-b3a3-455d-b012-bb6e092f3922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d6941-7ec6-4e52-9c8e-4a0fdc3181fb]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:31 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ee4a7e68-9ef8-45c6-b51c-79e3330b9d12 tempest-VolumesTransfersTest-1456424680 None] Created volume successfully.
Apr 17 05:33:31 devstack sudo[88927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c
Apr 17 05:33:31 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:31 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f.30df27e0-a585-4217-8c65-e34e4462ff1d" returned: 0 in 0.410s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-quobyte-30df27e0-a585-4217-8c65-e34e4462ff1d" released by "_delete_snapshot" :: held 1.908s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-quobyte-981303f4-d048-4147-8546-2aed8faa4b1f" released by "delete_snapshot" :: held 1.927s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Created reservations ['4c3a7987-c298-4390-832c-08457ad1ee33', '774d35e2-f5da-4e9d-89e7-0961314f5f50', '69276725-5959-48cc-a443-e5632b936729', '70b3919b-7b12-48f7-a5e6-1e47e98b1042'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:31 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Delete snapshot completed successfully.
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-76185ba8-d6ab-4a3b-9c20-1dd7181944e6 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-30df27e0-a585-4217-8c65-e34e4462ff1d-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "cinder-981303f4-d048-4147-8546-2aed8faa4b1f-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-981303f4-d048-4147-8546-2aed8faa4b1f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "cinder-quobyte-981303f4-d048-4147-8546-2aed8faa4b1f" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-quobyte-981303f4-d048-4147-8546-2aed8faa4b1f" acquired by "delete_volume" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c07e88a-26fa-491d-b3a1-9d60ebe2ec82]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Acquiring lock "cinder-4d4a8174-8147-4384-a172-8960eaa2ad7f-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Lock "cinder-4d4a8174-8147-4384-a172-8960eaa2ad7f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Acquiring lock "cinder-quobyte-4d4a8174-8147-4384-a172-8960eaa2ad7f" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Lock "cinder-quobyte-4d4a8174-8147-4384-a172-8960eaa2ad7f" acquired by "delete_volume" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af9f664-5a59-4bac-9609-8900bf9b73b4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:31 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f
Apr 17 05:33:31 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:31 devstack sudo[88931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f
Apr 17 05:33:31 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:32 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c" returned: 0 in 0.542s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d 2G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:32 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d 2G
Apr 17 05:33:32 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:32 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f" returned: 0 in 0.504s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:32 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f
Apr 17 05:33:32 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:32 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f" returned: 0 in 0.490s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:32 devstack sudo[88949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f
Apr 17 05:33:32 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:32 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d 2G" returned: 0 in 0.484s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e4a981-44b1-447a-9004-77cdc37ac21c -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:32 devstack sudo[88951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e4a981-44b1-447a-9004-77cdc37ac21c -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d
Apr 17 05:33:32 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:32 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-981303f4-d048-4147-8546-2aed8faa4b1f" returned: 0 in 0.438s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-quobyte-981303f4-d048-4147-8546-2aed8faa4b1f" released by "delete_volume" :: held 0.975s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:32 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Created reservations ['126f8005-e626-4129-ad2f-3fb6b3a3dea8', 'f9a1579f-dc65-48f7-95fa-e9126ea583c9', '72d78e24-5db7-4799-ae4a-b2417ac549a4', '1082fea7-6f21-4bc2-886b-2f65ce9beeaa'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-4d4a8174-8147-4384-a172-8960eaa2ad7f" returned: 0 in 0.439s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Lock "cinder-quobyte-4d4a8174-8147-4384-a172-8960eaa2ad7f" released by "delete_volume" :: held 0.960s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Created reservations ['7a80b320-15ba-4159-b90a-77e8373dbbc8', '3b0912ed-1cd5-4cef-b82d-1db7741468dc', '8c22d522-533c-4ea9-826c-56836375b220', 'a77d33dc-d5fd-47af-879a-5c9fc3fab984'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:32 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:32 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:32 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e4a981-44b1-447a-9004-77cdc37ac21c -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d" returned: 0 in 0.467s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:32 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d is being set with open permissions: ugo+rw
Apr 17 05:33:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:32 devstack sudo[88960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:32 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:32 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d
Apr 17 05:33:32 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:33 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.442s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Deleted volume successfully.
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c9c7b518-1d90-42bd-8fc5-b6ee73624a05 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-981303f4-d048-4147-8546-2aed8faa4b1f-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:33 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d" returned: 0 in 0.448s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:33 devstack sudo[88967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.info
Apr 17 05:33:33 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:33 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.508s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Deleted volume successfully.
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-1478b1ca-8221-4c93-bd9d-143400bb9f3f tempest-VolumesTransfersTest-1731950604 None] Lock "cinder-4d4a8174-8147-4384-a172-8960eaa2ad7f-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:33 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.info" returned: 0 in 0.490s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:33 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.info is being set with open permissions: ugo+rw
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "cinder-ced4af55-c392-4f9e-b0e0-ccf7d531be24-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:33 devstack sudo[88971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.info
Apr 17 05:33:33 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-ced4af55-c392-4f9e-b0e0-ccf7d531be24-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "cinder-quobyte-ced4af55-c392-4f9e-b0e0-ccf7d531be24" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-quobyte-ced4af55-c392-4f9e-b0e0-ccf7d531be24" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:34 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b414da4d-3522-4b2d-a1f2-db4d83d0aac8]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:34 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24
Apr 17 05:33:34 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:34 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.info" returned: 0 in 0.458s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.961s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:34 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-df16f128-74e1-414e-b8f5-533d04d26e92 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Create snapshot completed successfully
Apr 17 05:33:34 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24" returned: 0 in 0.554s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:34 devstack sudo[88979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24
Apr 17 05:33:34 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:35 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ced4af55-c392-4f9e-b0e0-ccf7d531be24" returned: 0 in 0.442s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-quobyte-ced4af55-c392-4f9e-b0e0-ccf7d531be24" released by "delete_volume" :: held 1.039s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Created reservations ['4a254876-62d2-4cad-939f-b3ed5a4b1169', '1d8496da-79f1-4e4b-b574-5204b6735562', '976f5b47-f2d6-463f-b3aa-2bab5fcc3b4a', 'e762586c-98e9-48e2-acab-429cf488a708'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Acquiring lock "cinder-8145b005-537b-42f7-88df-5934fc02f26d-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:35 devstack sudo[88982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "cinder-8145b005-537b-42f7-88df-5934fc02f26d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:35 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Acquiring lock "cinder-quobyte-52e4a981-44b1-447a-9004-77cdc37ac21c" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "cinder-quobyte-52e4a981-44b1-447a-9004-77cdc37ac21c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Acquiring lock "cinder-quobyte-8145b005-537b-42f7-88df-5934fc02f26d" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "cinder-quobyte-8145b005-537b-42f7-88df-5934fc02f26d" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Deleting offline snapshot 8145b005-537b-42f7-88df-5934fc02f26d of volume 52e4a981-44b1-447a-9004-77cdc37ac21c {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] snapshot_file for this snap is: volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc560e4-9a45-40af-a24d-3f59914f47da]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:35 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d
Apr 17 05:33:35 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:35 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.444s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:35 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Deleted volume successfully.
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bda6ea14-7b64-4896-8ead-ba36e8c21c79 tempest-CinderUnicodeTest-602004432 None] Lock "cinder-ced4af55-c392-4f9e-b0e0-ccf7d531be24-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:35 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d" returned: 0 in 0.530s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52e4a981-44b1-447a-9004-77cdc37ac21c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdcdfee-4625-4362-b477-33a02d8414a9]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:35 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c
Apr 17 05:33:35 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:36 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c" returned: 0 in 0.580s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:36 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d
Apr 17 05:33:36 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:36 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d" returned: 0 in 0.513s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:36 devstack sudo[89000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d
Apr 17 05:33:36 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Flow 'volume_create_manager' (1850477b-a0b9-49aa-9394-1e7e9f379672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04d1cbb-44d9-4df9-9cb6-e8436fc913ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04d1cbb-44d9-4df9-9cb6-e8436fc913ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1325554095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922bc1b1-5b91-475b-b083-4ed47c20af8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76374abad0db4127bf1a72cb54f89ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:37Z,use_quota=True,user_id='248d87e2e0f14e14988908b56af793b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddc90b7-69c1-4750-bdc1-88c25304de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddc90b7-69c1-4750-bdc1-88c25304de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5165a387-59e4-4c81-97cb-1a377623a86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5165a387-59e4-4c81-97cb-1a377623a86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '922bc1b1-5b91-475b-b083-4ed47c20af8a', 'volume_name': 'volume-922bc1b1-5b91-475b-b083-4ed47c20af8a', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71c83f7-b2c5-49db-9a3f-25159af32622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71c83f7-b2c5-49db-9a3f-25159af32622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4f7508-a6e4-4404-93b2-a791745bf654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:37 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Volume 922bc1b1-5b91-475b-b083-4ed47c20af8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-922bc1b1-5b91-475b-b083-4ed47c20af8a', 'volume_size': 1}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1325554095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922bc1b1-5b91-475b-b083-4ed47c20af8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76374abad0db4127bf1a72cb54f89ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:37Z,use_quota=True,user_id='248d87e2e0f14e14988908b56af793b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Creating volume 922bc1b1-5b91-475b-b083-4ed47c20af8a {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:37 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:37 devstack sudo[89003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a 1073741824
Apr 17 05:33:37 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:37 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c.8145b005-537b-42f7-88df-5934fc02f26d" returned: 0 in 0.429s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "cinder-quobyte-8145b005-537b-42f7-88df-5934fc02f26d" released by "_delete_snapshot" :: held 2.175s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "cinder-quobyte-52e4a981-44b1-447a-9004-77cdc37ac21c" released by "delete_snapshot" :: held 2.186s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Created reservations ['c71517d5-6ba8-4dc7-aeb5-df9f611a7385', '7710e1c9-1718-4524-8cde-ad128f517e45', 'ac727058-257c-4351-ae9d-2e5e780a8edc', '82d8f273-b053-46c7-a2c9-441ba06a67db'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:37 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Delete snapshot completed successfully.
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-8cf031cd-3919-4bcd-a35e-7507b1fcfbe0 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "cinder-8145b005-537b-42f7-88df-5934fc02f26d-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:37 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a 1073741824" returned: 0 in 0.517s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:37 devstack sudo[89009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a
Apr 17 05:33:37 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:38 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a" returned: 0 in 0.412s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4f7508-a6e4-4404-93b2-a791745bf654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-922bc1b1-5b91-475b-b083-4ed47c20af8a', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60843d2-86f3-40d5-ad00-fb1fc839d4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:38 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Volume volume-922bc1b1-5b91-475b-b083-4ed47c20af8a (922bc1b1-5b91-475b-b083-4ed47c20af8a): created successfully
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60843d2-86f3-40d5-ad00-fb1fc839d4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Flow 'volume_create_manager' (1850477b-a0b9-49aa-9394-1e7e9f379672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:38 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-b19cc6b2-97b6-4f3f-b10f-608badb59a9b tempest-VolumesTransfersV357Test-962514058 None] Created volume successfully.
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Acquiring lock "cinder-52e4a981-44b1-447a-9004-77cdc37ac21c-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "cinder-52e4a981-44b1-447a-9004-77cdc37ac21c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Acquiring lock "cinder-quobyte-52e4a981-44b1-447a-9004-77cdc37ac21c" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "cinder-quobyte-52e4a981-44b1-447a-9004-77cdc37ac21c" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1169712d-5797-46f4-ba9c-b54879277b32]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:38 devstack sudo[89012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c
Apr 17 05:33:38 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:38 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c" returned: 0 in 0.457s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:38 devstack sudo[89017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c
Apr 17 05:33:38 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:39 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-52e4a981-44b1-447a-9004-77cdc37ac21c" returned: 0 in 0.432s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "cinder-quobyte-52e4a981-44b1-447a-9004-77cdc37ac21c" released by "delete_volume" :: held 0.923s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Created reservations ['cc396c14-867b-4ffd-9de1-e68dfc4aef58', '78962308-2503-4d4d-84a2-a25e8f143edf', '25b02cee-ffcb-46c1-828f-4f063c4d8024', '6775c25e-e590-4e88-a2bb-15bb2f4b6923'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:39 devstack sudo[89020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:39 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:39 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-faf476ce-e9f8-49a7-ade5-21d006ed1def tempest-VolumesTransfersV357Test-44118220 None] Transfer volume completed successfully.
Apr 17 05:33:39 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:39 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Deleted volume successfully.
Apr 17 05:33:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6541b1f1-ce42-4515-b14f-284abc670452 tempest-VolumesSnapshotNegativeTestJSON-1565477485 None] Lock "cinder-52e4a981-44b1-447a-9004-77cdc37ac21c-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Acquiring lock "cinder-922bc1b1-5b91-475b-b083-4ed47c20af8a-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Lock "cinder-922bc1b1-5b91-475b-b083-4ed47c20af8a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Acquiring lock "cinder-quobyte-922bc1b1-5b91-475b-b083-4ed47c20af8a" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Lock "cinder-quobyte-922bc1b1-5b91-475b-b083-4ed47c20af8a" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:40 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcff6982-31ac-4637-9a60-098a19f72b21]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:40 devstack sudo[89023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a
Apr 17 05:33:40 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:41 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a" returned: 0 in 0.476s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:41 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a
Apr 17 05:33:41 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:41 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-922bc1b1-5b91-475b-b083-4ed47c20af8a" returned: 0 in 0.413s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Lock "cinder-quobyte-922bc1b1-5b91-475b-b083-4ed47c20af8a" released by "delete_volume" :: held 0.911s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Created reservations ['0f24e58a-aa48-43a0-92c5-f61189ad88d2', '08dad197-0ffe-4564-93ee-33deeb85a420', 'bb61670c-00e8-4628-99a6-bc24a2f185f0', 'bfb5501e-3da6-4c6b-8947-304f487ecfca'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:41 devstack sudo[89031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:41 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Flow 'volume_create_manager' (69894c50-f745-481e-ba64-0e13365f31c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572f1dd2-b8de-4059-b837-f1be1b825ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572f1dd2-b8de-4059-b837-f1be1b825ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1848147484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8cffed-b283-4db1-a0a0-20d9c38df4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76374abad0db4127bf1a72cb54f89ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:42Z,use_quota=True,user_id='248d87e2e0f14e14988908b56af793b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3e269b-28e7-4ca0-a34d-ef10a94a4801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3e269b-28e7-4ca0-a34d-ef10a94a4801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7262158-37a3-496d-b25a-876ae9cc57b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7262158-37a3-496d-b25a-876ae9cc57b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8cffed-b283-4db1-a0a0-20d9c38df4c3', 'volume_name': 'volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b6b59b-1664-4695-a944-bd6e14192c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b6b59b-1664-4695-a944-bd6e14192c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad45c41-d3f6-49af-9af0-efb462e313c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:41 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Volume ad8cffed-b283-4db1-a0a0-20d9c38df4c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3', 'volume_size': 1}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1848147484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8cffed-b283-4db1-a0a0-20d9c38df4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76374abad0db4127bf1a72cb54f89ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:42Z,use_quota=True,user_id='248d87e2e0f14e14988908b56af793b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Creating volume ad8cffed-b283-4db1-a0a0-20d9c38df4c3 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:41 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:41 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.443s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:41 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Deleted volume successfully.
Apr 17 05:33:41 devstack sudo[89034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3 1073741824
Apr 17 05:33:41 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dd217208-6257-4924-8c84-872f5e70864a tempest-VolumesTransfersV357Test-1485177879 None] Lock "cinder-922bc1b1-5b91-475b-b083-4ed47c20af8a-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:42 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3 1073741824" returned: 0 in 0.473s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:42 devstack sudo[89039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3
Apr 17 05:33:42 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:42 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3" returned: 0 in 0.433s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad45c41-d3f6-49af-9af0-efb462e313c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98df2d5c-a337-4f07-8f87-069c6ee0dc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:42 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Volume volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3 (ad8cffed-b283-4db1-a0a0-20d9c38df4c3): created successfully
Apr 17 05:33:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98df2d5c-a337-4f07-8f87-069c6ee0dc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Flow 'volume_create_manager' (69894c50-f745-481e-ba64-0e13365f31c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:42 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c85e0912-7990-40ad-96e3-38c2fd0d82cb tempest-VolumesTransfersV357Test-962514058 None] Created volume successfully.
Apr 17 05:33:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Acquiring lock "cinder-ad8cffed-b283-4db1-a0a0-20d9c38df4c3-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Lock "cinder-ad8cffed-b283-4db1-a0a0-20d9c38df4c3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Acquiring lock "cinder-quobyte-ad8cffed-b283-4db1-a0a0-20d9c38df4c3" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Lock "cinder-quobyte-ad8cffed-b283-4db1-a0a0-20d9c38df4c3" acquired by "delete_volume" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:44 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fbc223-2401-4386-94df-0fa208fbc690]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:44 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3
Apr 17 05:33:44 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:44 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3" returned: 0 in 0.466s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:44 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3
Apr 17 05:33:44 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:45 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ad8cffed-b283-4db1-a0a0-20d9c38df4c3" returned: 0 in 0.416s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Lock "cinder-quobyte-ad8cffed-b283-4db1-a0a0-20d9c38df4c3" released by "delete_volume" :: held 0.906s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Created reservations ['2c14eebc-277a-4d3c-91cc-cfc1a728fefa', '0d291483-acfa-4f56-9099-66a99ce1ffba', '2a45debc-8104-4194-be64-81f331d7d295', '5fe26d94-cd3b-44ff-8c5c-608ce6b9e9eb'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:45 devstack sudo[89050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:45 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:45 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.418s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:45 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Deleted volume successfully.
Apr 17 05:33:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-011a065a-46f8-4584-8849-71ff1865cd3f tempest-VolumesTransfersV357Test-1485177879 None] Lock "cinder-ad8cffed-b283-4db1-a0a0-20d9c38df4c3-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Flow 'volume_create_manager' (2e6b2f07-42d1-4d5d-9d82-40e563cdea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae7e16b-9e05-496e-b3ad-4571508e0433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae7e16b-9e05-496e-b3ad-4571508e0433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2013129275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf89408-f53b-404c-806d-d6a8e898b202,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e43eaac22d4d69a01c8451951ff95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:48Z,use_quota=True,user_id='46567f7935184fc7ba7ad075a9f8cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed32b1b8-fc09-4aa9-ae7e-3ce62199d14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed32b1b8-fc09-4aa9-ae7e-3ce62199d14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1919e8f-a2e2-4dca-9c5a-337bfd3eca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1919e8f-a2e2-4dca-9c5a-337bfd3eca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bf89408-f53b-404c-806d-d6a8e898b202', 'volume_name': 'volume-1bf89408-f53b-404c-806d-d6a8e898b202', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f355bed-dc67-48df-afba-8838c5aab9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f355bed-dc67-48df-afba-8838c5aab9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c768eec-b996-440e-8aa2-823c4a5769c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:48 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Volume 1bf89408-f53b-404c-806d-d6a8e898b202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bf89408-f53b-404c-806d-d6a8e898b202', 'volume_size': 1}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2013129275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf89408-f53b-404c-806d-d6a8e898b202,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e43eaac22d4d69a01c8451951ff95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:48Z,use_quota=True,user_id='46567f7935184fc7ba7ad075a9f8cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Creating volume 1bf89408-f53b-404c-806d-d6a8e898b202 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:48 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:48 devstack sudo[89062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202 1073741824
Apr 17 05:33:48 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:48 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202 1073741824" returned: 0 in 0.468s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:48 devstack sudo[89067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202
Apr 17 05:33:48 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:49 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202" returned: 0 in 0.404s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:49 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c768eec-b996-440e-8aa2-823c4a5769c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bf89408-f53b-404c-806d-d6a8e898b202', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa637ae-d4dc-49b1-ae23-0f84884c6420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:49 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Volume volume-1bf89408-f53b-404c-806d-d6a8e898b202 (1bf89408-f53b-404c-806d-d6a8e898b202): created successfully
Apr 17 05:33:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa637ae-d4dc-49b1-ae23-0f84884c6420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:49 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Flow 'volume_create_manager' (2e6b2f07-42d1-4d5d-9d82-40e563cdea6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:49 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-cc325d72-4713-4133-9af5-680aefbb9a5f tempest-VolumesListTestJSON-1002065964 None] Created volume successfully.
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Flow 'volume_create_manager' (b3b9e050-261f-41e2-8d88-37a64b4773b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcbe317-ae53-415d-85b2-223e53668fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcbe317-ae53-415d-85b2-223e53668fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-164188322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10927fbc-3358-44e7-acd5-4091b6504bd2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e43eaac22d4d69a01c8451951ff95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:51Z,use_quota=True,user_id='46567f7935184fc7ba7ad075a9f8cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d1f493-3c87-4dd8-aee7-21f30a107cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d1f493-3c87-4dd8-aee7-21f30a107cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7f7045-3e2c-4dc8-8da5-f2d83cbb4943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7f7045-3e2c-4dc8-8da5-f2d83cbb4943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10927fbc-3358-44e7-acd5-4091b6504bd2', 'volume_name': 'volume-10927fbc-3358-44e7-acd5-4091b6504bd2', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ddd7dd-49d2-4f35-9948-e7c29e3a215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ddd7dd-49d2-4f35-9948-e7c29e3a215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785c0571-7c5c-4a2a-be1c-5554175af0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:50 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Volume 10927fbc-3358-44e7-acd5-4091b6504bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10927fbc-3358-44e7-acd5-4091b6504bd2', 'volume_size': 1}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-164188322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10927fbc-3358-44e7-acd5-4091b6504bd2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e43eaac22d4d69a01c8451951ff95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:51Z,use_quota=True,user_id='46567f7935184fc7ba7ad075a9f8cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Creating volume 10927fbc-3358-44e7-acd5-4091b6504bd2 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:50 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:50 devstack sudo[89070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2 1073741824
Apr 17 05:33:50 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:51 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2 1073741824" returned: 0 in 0.478s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:51 devstack sudo[89075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2
Apr 17 05:33:51 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:51 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2" returned: 0 in 0.419s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785c0571-7c5c-4a2a-be1c-5554175af0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10927fbc-3358-44e7-acd5-4091b6504bd2', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2ac06e-f829-44de-bb00-913b598d32b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:51 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Volume volume-10927fbc-3358-44e7-acd5-4091b6504bd2 (10927fbc-3358-44e7-acd5-4091b6504bd2): created successfully
Apr 17 05:33:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2ac06e-f829-44de-bb00-913b598d32b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Flow 'volume_create_manager' (b3b9e050-261f-41e2-8d88-37a64b4773b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:51 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1c8bfe08-6ce8-45b0-942f-d00fe33a86c6 tempest-VolumesListTestJSON-1002065964 None] Created volume successfully.
Apr 17 05:33:52 devstack cinder-volume[82266]: DEBUG oslo_service.periodic_task [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:33:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:52 devstack sudo[89078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:52 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:52 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:33:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Flow 'volume_create_manager' (c63f6144-37ed-4a09-bdbb-ec0fb4c25a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ae0b91-ed1b-40ae-b5d6-df30f7e701e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ae0b91-ed1b-40ae-b5d6-df30f7e701e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-641667950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7190e7f1-6e8a-4073-b00c-486a4e4a0f66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e43eaac22d4d69a01c8451951ff95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:53Z,use_quota=True,user_id='46567f7935184fc7ba7ad075a9f8cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22918c04-6aa4-4fb2-a787-4b19aa69b99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22918c04-6aa4-4fb2-a787-4b19aa69b99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2ab943-3f6c-4eed-881e-ce9627c853f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2ab943-3f6c-4eed-881e-ce9627c853f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7190e7f1-6e8a-4073-b00c-486a4e4a0f66', 'volume_name': 'volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd98cd4-15b3-4f05-934a-e594933f62b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd98cd4-15b3-4f05-934a-e594933f62b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018ada24-0ae5-45fd-9ca9-fc3afc007915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:53 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Volume 7190e7f1-6e8a-4073-b00c-486a4e4a0f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66', 'volume_size': 1}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-641667950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7190e7f1-6e8a-4073-b00c-486a4e4a0f66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e43eaac22d4d69a01c8451951ff95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:33:53Z,use_quota=True,user_id='46567f7935184fc7ba7ad075a9f8cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Creating volume 7190e7f1-6e8a-4073-b00c-486a4e4a0f66 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:33:53 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:53 devstack sudo[89080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66 1073741824
Apr 17 05:33:53 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:53 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.441s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:53 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66 1073741824" returned: 0 in 0.484s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:53 devstack sudo[89086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66
Apr 17 05:33:53 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:53 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66" returned: 0 in 0.397s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018ada24-0ae5-45fd-9ca9-fc3afc007915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a84109-79c4-49cf-9994-5825ada801ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:33:53 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Volume volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66 (7190e7f1-6e8a-4073-b00c-486a4e4a0f66): created successfully
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a84109-79c4-49cf-9994-5825ada801ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:33:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Flow 'volume_create_manager' (c63f6144-37ed-4a09-bdbb-ec0fb4c25a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:33:53 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-57b89e9f-ad5a-4993-aebf-87bf4c4afe4d tempest-VolumesListTestJSON-1002065964 None] Created volume successfully.
Apr 17 05:33:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "cinder-7190e7f1-6e8a-4073-b00c-486a4e4a0f66-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-7190e7f1-6e8a-4073-b00c-486a4e4a0f66-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "cinder-quobyte-7190e7f1-6e8a-4073-b00c-486a4e4a0f66" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-quobyte-7190e7f1-6e8a-4073-b00c-486a4e4a0f66" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:57 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ac6760-4716-41e2-a990-5933d4e01c87]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:57 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66
Apr 17 05:33:57 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:57 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66" returned: 0 in 0.482s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:57 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66
Apr 17 05:33:57 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:58 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7190e7f1-6e8a-4073-b00c-486a4e4a0f66" returned: 0 in 0.403s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-quobyte-7190e7f1-6e8a-4073-b00c-486a4e4a0f66" released by "delete_volume" :: held 0.910s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Created reservations ['3a1cad25-5b23-4bd8-bbc8-84c389d1a22e', '77c52c7d-4053-421e-be39-3d005f6fcb1e', '71a53fa9-c459-4b58-9f03-cdaad2b62db8', 'b54bbb7d-cf33-4818-81f4-89d0d844baa2'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:58 devstack sudo[89098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:58 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "cinder-10927fbc-3358-44e7-acd5-4091b6504bd2-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-10927fbc-3358-44e7-acd5-4091b6504bd2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "cinder-quobyte-10927fbc-3358-44e7-acd5-4091b6504bd2" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-quobyte-10927fbc-3358-44e7-acd5-4091b6504bd2" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffed027-b652-49dd-984d-ccfb7a087ac1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:58 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2
Apr 17 05:33:58 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:58 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.424s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Deleted volume successfully.
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dc0c8cae-f7fd-482a-82b6-f85fab94f8fa tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-7190e7f1-6e8a-4073-b00c-486a4e4a0f66-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:58 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2" returned: 0 in 0.463s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:58 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2
Apr 17 05:33:58 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:59 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-10927fbc-3358-44e7-acd5-4091b6504bd2" returned: 0 in 0.400s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-quobyte-10927fbc-3358-44e7-acd5-4091b6504bd2" released by "delete_volume" :: held 0.886s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Created reservations ['a68618a8-13ca-400a-af67-b9510afad58d', '828f33ad-2e8b-400d-a7d1-a83d9a9736cc', 'd0a5521b-4f1c-4b2a-8524-5c58bc08f0ba', '2477ca16-3929-438a-b44b-e3c3fcec2a37'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:59 devstack sudo[89110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:33:59 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "cinder-1bf89408-f53b-404c-806d-d6a8e898b202-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-1bf89408-f53b-404c-806d-d6a8e898b202-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "cinder-quobyte-1bf89408-f53b-404c-806d-d6a8e898b202" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-quobyte-1bf89408-f53b-404c-806d-d6a8e898b202" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5f8152-56f2-4883-8cc6-943af3c0e989]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:59 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202
Apr 17 05:33:59 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:33:59 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.437s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:33:59 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Deleted volume successfully.
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7c8f0c47-e91c-404c-9bce-6fe9e34061ef tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-10927fbc-3358-44e7-acd5-4091b6504bd2-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:33:59 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202" returned: 0 in 0.473s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:33:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:33:59 devstack sudo[89118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202
Apr 17 05:33:59 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:00 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1bf89408-f53b-404c-806d-d6a8e898b202" returned: 0 in 0.422s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-quobyte-1bf89408-f53b-404c-806d-d6a8e898b202" released by "delete_volume" :: held 0.918s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:UPDATE=214,cinder:SELECT=161,cinder:DELETE=18,cinder:INSERT=62 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=173,cinder:INSERT=60,cinder:UPDATE=225,cinder:DELETE=19 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Created reservations ['b3c037f3-1aea-4299-84b8-915a99278463', 'a72b6985-4cab-4521-982f-fcf66e4869a2', 'fdf1198a-be8a-4ce1-a690-4e31927b7a5b', '933c831d-fc99-4d56-b23d-f5fc15e077ea'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:00 devstack sudo[89121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:34:00 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:00 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.460s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:34:00 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Deleted volume successfully.
Apr 17 05:34:00 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d1d08307-391f-4d73-ba80-2dc0bb68b4e1 tempest-VolumesListTestJSON-1002065964 None] Lock "cinder-1bf89408-f53b-404c-806d-d6a8e898b202-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Flow 'volume_create_manager' (6df7fc4f-68f8-41f2-8343-07a3f06abeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9e49c3-efa3-4ef2-804c-b404c9dc089a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9e49c3-efa3-4ef2-804c-b404c9dc089a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-968518536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1facec6-5938-4aae-9484-4ee59f7da635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07efca847f04015979313fbdd8b7492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:10Z,use_quota=True,user_id='bcac5e268b4e4f9ea8fdc4f2b5ecf564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded16b90-68e5-4342-bdf6-fc9519866ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded16b90-68e5-4342-bdf6-fc9519866ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab5229cf-c56a-4b15-8799-4054fdabc55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab5229cf-c56a-4b15-8799-4054fdabc55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1facec6-5938-4aae-9484-4ee59f7da635', 'volume_name': 'volume-a1facec6-5938-4aae-9484-4ee59f7da635', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa77a76-fe3a-476f-9b9f-1c50a9a5631b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa77a76-fe3a-476f-9b9f-1c50a9a5631b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfb3836-7e44-4b79-82eb-d60a45db1a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:09 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Volume a1facec6-5938-4aae-9484-4ee59f7da635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1facec6-5938-4aae-9484-4ee59f7da635', 'volume_size': 1}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-968518536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1facec6-5938-4aae-9484-4ee59f7da635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07efca847f04015979313fbdd8b7492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:10Z,use_quota=True,user_id='bcac5e268b4e4f9ea8fdc4f2b5ecf564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Creating volume a1facec6-5938-4aae-9484-4ee59f7da635 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:34:09 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:34:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:10 devstack sudo[89160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635 1073741824
Apr 17 05:34:10 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:10 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635 1073741824" returned: 0 in 0.488s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:10 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635
Apr 17 05:34:10 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:10 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635" returned: 0 in 0.419s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:34:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfb3836-7e44-4b79-82eb-d60a45db1a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1facec6-5938-4aae-9484-4ee59f7da635', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8fe78c-0e72-4950-9ddd-865cd7178f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:10 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Volume volume-a1facec6-5938-4aae-9484-4ee59f7da635 (a1facec6-5938-4aae-9484-4ee59f7da635): created successfully
Apr 17 05:34:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8fe78c-0e72-4950-9ddd-865cd7178f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Flow 'volume_create_manager' (6df7fc4f-68f8-41f2-8343-07a3f06abeb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:10 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dd546666-8939-405f-b4aa-010acbc50e65 tempest-VolumesSnapshotTestJSON-1524391743 None] Created volume successfully.
Apr 17 05:34:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Creating offline snapshot 8847f825-6356-4f5f-ae45-be05235e99db of volume a1facec6-5938-4aae-9484-4ee59f7da635 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:34:12 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[16661d40-d4d7-4f4c-8a47-cb5df95cba06]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:12 devstack sudo[89168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635
Apr 17 05:34:12 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:12 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635" returned: 0 in 0.475s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:12 devstack sudo[89173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db 1G
Apr 17 05:34:12 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:13 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db 1G" returned: 0 in 0.472s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1facec6-5938-4aae-9484-4ee59f7da635 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:13 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1facec6-5938-4aae-9484-4ee59f7da635 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db
Apr 17 05:34:13 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:13 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1facec6-5938-4aae-9484-4ee59f7da635 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db" returned: 0 in 0.428s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:13 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db is being set with open permissions: ugo+rw
Apr 17 05:34:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:13 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db
Apr 17 05:34:13 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:14 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db" returned: 0 in 0.400s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:14 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.info
Apr 17 05:34:14 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:14 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.info" returned: 0 in 0.446s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:14 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.info is being set with open permissions: ugo+rw
Apr 17 05:34:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:14 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.info
Apr 17 05:34:14 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:14 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.info" returned: 0 in 0.399s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4a105b10-fb3a-4031-92fa-df067b2d0fb3 tempest-VolumesSnapshotTestJSON-1524391743 None] Create snapshot completed successfully
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-8847f825-6356-4f5f-ae45-be05235e99db-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-8847f825-6356-4f5f-ae45-be05235e99db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-a1facec6-5938-4aae-9484-4ee59f7da635" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-a1facec6-5938-4aae-9484-4ee59f7da635" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-8847f825-6356-4f5f-ae45-be05235e99db" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-8847f825-6356-4f5f-ae45-be05235e99db" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Deleting offline snapshot 8847f825-6356-4f5f-ae45-be05235e99db of volume a1facec6-5938-4aae-9484-4ee59f7da635 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] snapshot_file for this snap is: volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c01f05d-7757-4e38-bb71-de1e3403a757]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:15 devstack sudo[89192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db
Apr 17 05:34:15 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:15 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db" returned: 0 in 0.461s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1facec6-5938-4aae-9484-4ee59f7da635(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5040adea-b8e2-407c-828a-6f68266d1fb4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:16 devstack sudo[89197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635
Apr 17 05:34:16 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:16 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:16 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db
Apr 17 05:34:16 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:16 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db" returned: 0 in 0.440s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:16 devstack sudo[89207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db
Apr 17 05:34:16 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:17 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635.8847f825-6356-4f5f-ae45-be05235e99db" returned: 0 in 0.423s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-8847f825-6356-4f5f-ae45-be05235e99db" released by "_delete_snapshot" :: held 1.848s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-a1facec6-5938-4aae-9484-4ee59f7da635" released by "delete_snapshot" :: held 1.858s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Created reservations ['35e12f9f-9fbd-4305-a834-dd93bd81fc0a', '586ef915-ba74-4595-a8ab-8f4bebcd3874', 'ff80d433-6e1f-44a2-b423-7624d43b38f1', '01e60b06-e2ef-4a17-8716-2b9370d371b1'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:34:17 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Delete snapshot completed successfully.
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-4a0cf040-8b4d-4b7e-a162-01f95a47b23a tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-8847f825-6356-4f5f-ae45-be05235e99db-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Flow 'volume_create_manager' (1b34bbdf-e876-4bc5-bb0b-283935c32dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98144ee3-0336-45f5-9118-9076030d6615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98144ee3-0336-45f5-9118-9076030d6615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2094541230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74da280-7859-4b29-ba95-ccd4a97b7b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07efca847f04015979313fbdd8b7492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:18Z,use_quota=True,user_id='bcac5e268b4e4f9ea8fdc4f2b5ecf564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5093c46-5f97-47ab-9513-a3e37324be5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5093c46-5f97-47ab-9513-a3e37324be5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e8fb93-dd51-4e72-8837-040ab25cd73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e8fb93-dd51-4e72-8837-040ab25cd73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c74da280-7859-4b29-ba95-ccd4a97b7b3a', 'volume_name': 'volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3e0041-6b7f-40ca-9a99-52658ae13df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3e0041-6b7f-40ca-9a99-52658ae13df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caf9200-4d5d-442f-a3cf-9e3f896515b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:17 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Volume c74da280-7859-4b29-ba95-ccd4a97b7b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a', 'volume_size': 1}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2094541230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74da280-7859-4b29-ba95-ccd4a97b7b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07efca847f04015979313fbdd8b7492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:18Z,use_quota=True,user_id='bcac5e268b4e4f9ea8fdc4f2b5ecf564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Creating volume c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:34:17 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:34:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:17 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a 1073741824
Apr 17 05:34:17 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:18 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a 1073741824" returned: 0 in 0.489s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:18 devstack sudo[89216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a
Apr 17 05:34:18 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:18 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a" returned: 0 in 0.415s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:34:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caf9200-4d5d-442f-a3cf-9e3f896515b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db33eb6-308c-4fd1-9527-27f5790f695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:18 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Volume volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a (c74da280-7859-4b29-ba95-ccd4a97b7b3a): created successfully
Apr 17 05:34:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db33eb6-308c-4fd1-9527-27f5790f695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Flow 'volume_create_manager' (1b34bbdf-e876-4bc5-bb0b-283935c32dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:18 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-06f7bd2c-2bd4-4e40-9776-c58323e5ecb4 tempest-VolumesSnapshotTestJSON-1524391743 None] Created volume successfully.
Apr 17 05:34:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Creating offline snapshot f1165a62-4ea5-4fe6-a382-139140c14908 of volume c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:34:20 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f85292-e026-45f3-b0c0-fa55dc6f6491]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:20 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a
Apr 17 05:34:20 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:20 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a" returned: 0 in 0.475s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:20 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 1G
Apr 17 05:34:20 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:20 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 1G" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:20 devstack sudo[89229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908
Apr 17 05:34:20 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:21 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908" returned: 0 in 0.438s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:21 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 is being set with open permissions: ugo+rw
Apr 17 05:34:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:21 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908
Apr 17 05:34:21 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:21 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908" returned: 0 in 0.411s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:21 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.info
Apr 17 05:34:21 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:22 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.info" returned: 0 in 0.417s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:22 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.info is being set with open permissions: ugo+rw
Apr 17 05:34:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:22 devstack sudo[89241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.info
Apr 17 05:34:22 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:22 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.info" returned: 0 in 0.410s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.675s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:22 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-778b3765-28b5-4024-adba-9fa6a2ce4296 tempest-VolumesSnapshotTestJSON-1524391743 None] Create snapshot completed successfully
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Flow 'volume_create_manager' (50af3a91-5afa-4432-b0b1-a19359c3540a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b2c395-7898-46b7-8bd8-80a7f91d1c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b2c395-7898-46b7-8bd8-80a7f91d1c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1500177730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efd21cf-410b-4417-9c3b-957b946503b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07efca847f04015979313fbdd8b7492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f1165a62-4ea5-4fe6-a382-139140c14908,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:23Z,use_quota=True,user_id='bcac5e268b4e4f9ea8fdc4f2b5ecf564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dc622f-12fd-466e-b9c3-973c5e010ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dc622f-12fd-466e-b9c3-973c5e010ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52ef49d-8777-40e3-befd-af3930d4d8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52ef49d-8777-40e3-befd-af3930d4d8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1efd21cf-410b-4417-9c3b-957b946503b2', 'volume_name': 'volume-1efd21cf-410b-4417-9c3b-957b946503b2', 'volume_size': 2, 'snapshot_id': 'f1165a62-4ea5-4fe6-a382-139140c14908'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a2e51f-ef35-447b-a9f0-b79041331727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a2e51f-ef35-447b-a9f0-b79041331727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd24f91-2bea-42bb-a13d-dcaba6f10dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:23 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Volume 1efd21cf-410b-4417-9c3b-957b946503b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1efd21cf-410b-4417-9c3b-957b946503b2', 'volume_size': 2, 'snapshot_id': 'f1165a62-4ea5-4fe6-a382-139140c14908'}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-f1165a62-4ea5-4fe6-a382-139140c14908-1efd21cf-410b-4417-9c3b-957b946503b2" by "_create_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-f1165a62-4ea5-4fe6-a382-139140c14908-1efd21cf-410b-4417-9c3b-957b946503b2" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Creating volume 1efd21cf-410b-4417-9c3b-957b946503b2 from snapshot f1165a62-4ea5-4fe6-a382-139140c14908 {{(pid=82266) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-1efd21cf-410b-4417-9c3b-957b946503b2" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-1efd21cf-410b-4417-9c3b-957b946503b2" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] snapshot: f1165a62-4ea5-4fe6-a382-139140c14908, volume: 1efd21cf-410b-4417-9c3b-957b946503b2,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f9872a-78e1-42ad-8376-90be7ef5c36d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:23 devstack sudo[89244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908
Apr 17 05:34:23 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:23 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6154a311-cca0-4666-b9ac-a31030b21bc0]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:24 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a
Apr 17 05:34:24 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:24 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a" returned: 0 in 0.477s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:24 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2 not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:34:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:24 devstack sudo[89254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2
Apr 17 05:34:24 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:26 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2" returned: 0 in 1.917s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:26 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fce300-7403-4d07-8f61-05d081ef5701]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:26 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a
Apr 17 05:34:26 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:26 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a" returned: 0 in 0.597s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:26 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2 {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:34:26 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Converted 1024.00 MB image at 533.69 MB/s
Apr 17 05:34:26 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2 is being set with open permissions: ugo+rw
Apr 17 05:34:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:26 devstack sudo[89271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2
Apr 17 05:34:26 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:27 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2" returned: 0 in 0.398s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-1efd21cf-410b-4417-9c3b-957b946503b2" released by "_copy_volume_from_snapshot" :: held 3.914s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-f1165a62-4ea5-4fe6-a382-139140c14908-1efd21cf-410b-4417-9c3b-957b946503b2" released by "_create_volume_from_snapshot" :: held 3.928s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.936s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd24f91-2bea-42bb-a13d-dcaba6f10dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efd21cf-410b-4417-9c3b-957b946503b2', 'volume_size': 2, 'snapshot_id': 'f1165a62-4ea5-4fe6-a382-139140c14908'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6bc804-dade-4395-888d-3f986b1485ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:27 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Volume volume-1efd21cf-410b-4417-9c3b-957b946503b2 (1efd21cf-410b-4417-9c3b-957b946503b2): created successfully
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6bc804-dade-4395-888d-3f986b1485ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Flow 'volume_create_manager' (50af3a91-5afa-4432-b0b1-a19359c3540a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:27 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-57118702-c95b-4154-b704-4025dd79f1eb tempest-VolumesSnapshotTestJSON-1524391743 None] Created volume successfully.
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-1efd21cf-410b-4417-9c3b-957b946503b2-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-1efd21cf-410b-4417-9c3b-957b946503b2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-1efd21cf-410b-4417-9c3b-957b946503b2" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-1efd21cf-410b-4417-9c3b-957b946503b2" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcea1d7-c542-48be-8294-c3d8959e3dbd]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:27 devstack sudo[89275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2
Apr 17 05:34:27 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:28 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2" returned: 0 in 0.473s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:28 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2
Apr 17 05:34:28 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:28 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1efd21cf-410b-4417-9c3b-957b946503b2" returned: 0 in 0.401s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-1efd21cf-410b-4417-9c3b-957b946503b2" released by "delete_volume" :: held 0.905s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Created reservations ['d08dbb1f-58d7-4b85-b192-e3960a0183e8', 'cd95337d-7305-4f06-997a-c235e75f3dd8', '57a1e3b5-501c-4a42-b48b-5e5de0b899d6', 'c9fa4439-e5be-4ad5-b1e0-ce3f0e681822'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:28 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:34:28 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-f1165a62-4ea5-4fe6-a382-139140c14908-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-f1165a62-4ea5-4fe6-a382-139140c14908-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-c74da280-7859-4b29-ba95-ccd4a97b7b3a" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-c74da280-7859-4b29-ba95-ccd4a97b7b3a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-f1165a62-4ea5-4fe6-a382-139140c14908" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-f1165a62-4ea5-4fe6-a382-139140c14908" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Deleting offline snapshot f1165a62-4ea5-4fe6-a382-139140c14908 of volume c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] snapshot_file for this snap is: volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[10476aaf-8644-4b3f-a775-a046a9e60ee1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:28 devstack sudo[89285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908
Apr 17 05:34:28 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:29 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.441s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:29 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:34:29 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Deleted volume successfully.
Apr 17 05:34:29 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-13cbd5a8-89c1-4ea1-a5c2-9d15edfc82b1 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-1efd21cf-410b-4417-9c3b-957b946503b2-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:29 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908" returned: 0 in 0.478s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:34:29 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dec8347-72c3-4267-b9ce-034bbb08e41d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:29 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a
Apr 17 05:34:29 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:29 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:29 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908
Apr 17 05:34:29 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:30 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908" returned: 0 in 0.456s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:30 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908
Apr 17 05:34:30 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:30 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a.f1165a62-4ea5-4fe6-a382-139140c14908" returned: 0 in 0.407s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-f1165a62-4ea5-4fe6-a382-139140c14908" released by "_delete_snapshot" :: held 1.861s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-c74da280-7859-4b29-ba95-ccd4a97b7b3a" released by "delete_snapshot" :: held 1.872s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Created reservations ['dfa18cb9-3055-4c74-a91b-ee6b0620dcec', 'a56e1a3e-f6f3-41c6-98ad-0d3608cb95c8', 'a557a8c1-e51a-4fb9-beda-0e36d76464e1', 'd5323ace-432b-4e8f-b974-6537b3d56930'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:34:30 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Delete snapshot completed successfully.
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-2ec95698-e895-46c5-b153-01de9251269e tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-f1165a62-4ea5-4fe6-a382-139140c14908-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-c74da280-7859-4b29-ba95-ccd4a97b7b3a-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-c74da280-7859-4b29-ba95-ccd4a97b7b3a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-c74da280-7859-4b29-ba95-ccd4a97b7b3a" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-c74da280-7859-4b29-ba95-ccd4a97b7b3a" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a46d863-1f2c-4994-9981-b793a6464ebe]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:31 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a
Apr 17 05:34:31 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:31 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:31 devstack sudo[89309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a
Apr 17 05:34:31 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:31 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-c74da280-7859-4b29-ba95-ccd4a97b7b3a" returned: 0 in 0.408s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-c74da280-7859-4b29-ba95-ccd4a97b7b3a" released by "delete_volume" :: held 0.914s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Created reservations ['9124fd1b-443d-4ffa-a7a5-17eaab94f1c2', '766f73ef-d62f-4af5-9d90-53ed2dbe1aa8', '951311f7-25d4-489f-9036-9b848a5072fd', 'bbf8c79b-4a7f-4722-b5cc-eefe948c5d88'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:32 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:34:32 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Flow 'volume_create_manager' (5a7dce54-75e4-4bcb-98f1-200130ab46dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dfe4fb-d5bc-4238-8a77-50a664d28ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dfe4fb-d5bc-4238-8a77-50a664d28ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-945280142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fed4159-a039-4fad-81fe-82c5e6a08c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07efca847f04015979313fbdd8b7492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:32Z,use_quota=True,user_id='bcac5e268b4e4f9ea8fdc4f2b5ecf564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf61227b-5b50-492a-ae6a-9495b4094233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf61227b-5b50-492a-ae6a-9495b4094233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0f906b-6817-47bd-9000-3ced8af14b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0f906b-6817-47bd-9000-3ced8af14b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fed4159-a039-4fad-81fe-82c5e6a08c9b', 'volume_name': 'volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6f3852-07b4-4e6e-a1fc-c03d9dac8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6f3852-07b4-4e6e-a1fc-c03d9dac8191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7419cb7-8573-45b6-b26a-43865d5b9523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:32 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Volume 7fed4159-a039-4fad-81fe-82c5e6a08c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b', 'volume_size': 1}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-945280142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fed4159-a039-4fad-81fe-82c5e6a08c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07efca847f04015979313fbdd8b7492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:32Z,use_quota=True,user_id='bcac5e268b4e4f9ea8fdc4f2b5ecf564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Creating volume 7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:34:32 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:32 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b 1073741824
Apr 17 05:34:32 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:32 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:34:32 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Deleted volume successfully.
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-dca89222-5291-4db2-9b8b-f93126762407 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-c74da280-7859-4b29-ba95-ccd4a97b7b3a-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:32 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b 1073741824" returned: 0 in 0.480s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:32 devstack sudo[89320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b
Apr 17 05:34:32 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:33 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b" returned: 0 in 0.418s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:34:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7419cb7-8573-45b6-b26a-43865d5b9523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acc8d84-845a-4b4b-a735-db8f910f7ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:33 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Volume volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b (7fed4159-a039-4fad-81fe-82c5e6a08c9b): created successfully
Apr 17 05:34:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acc8d84-845a-4b4b-a735-db8f910f7ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Flow 'volume_create_manager' (5a7dce54-75e4-4bcb-98f1-200130ab46dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-670153d6-d85a-4389-a365-4eacc950dd8f tempest-VolumesSnapshotTestJSON-1524391743 None] Created volume successfully.
Apr 17 05:34:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Creating offline snapshot 1367c3d0-7fea-456f-8371-76a6e9dc73aa of volume 7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:34:34 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71c6308-3a7c-4467-988a-6cdd837a1968]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:34 devstack sudo[89323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b
Apr 17 05:34:34 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:35 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b" returned: 0 in 0.457s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:35 devstack sudo[89328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa 1G
Apr 17 05:34:35 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:35 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa 1G" returned: 0 in 0.469s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:35 devstack sudo[89333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa
Apr 17 05:34:35 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:35 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa" returned: 0 in 0.440s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:35 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa is being set with open permissions: ugo+rw
Apr 17 05:34:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:35 devstack sudo[89338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa
Apr 17 05:34:35 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:36 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa" returned: 0 in 0.403s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:36 devstack sudo[89341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.info
Apr 17 05:34:36 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:36 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.info" returned: 0 in 0.418s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:36 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.info is being set with open permissions: ugo+rw
Apr 17 05:34:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:36 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.info
Apr 17 05:34:36 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:37 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.info" returned: 0 in 0.410s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:37 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8e0d37a0-7175-4e86-8d7c-37affbb47c73 tempest-VolumesSnapshotTestJSON-1524391743 None] Create snapshot completed successfully
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Flow 'volume_create_manager' (0621df5b-9b07-458b-8ef2-469cdb2b4e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efabcf82-a2de-4bb6-86bd-d6322be0ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efabcf82-a2de-4bb6-86bd-d6322be0ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-242302526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ba050d-7f90-41c7-b8a6-8a853e7852f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07efca847f04015979313fbdd8b7492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1367c3d0-7fea-456f-8371-76a6e9dc73aa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:38Z,use_quota=True,user_id='bcac5e268b4e4f9ea8fdc4f2b5ecf564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3fca72-0ac1-4257-bfd2-788be65932a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3fca72-0ac1-4257-bfd2-788be65932a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296b14cc-8499-4556-b46d-6c1376219081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296b14cc-8499-4556-b46d-6c1376219081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f7ba050d-7f90-41c7-b8a6-8a853e7852f6', 'volume_name': 'volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6', 'volume_size': 1, 'snapshot_id': '1367c3d0-7fea-456f-8371-76a6e9dc73aa'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ff46b0-bb3f-4d48-ae8c-8c01ee15d2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ff46b0-bb3f-4d48-ae8c-8c01ee15d2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b66deb1-6a33-4a65-b892-d8a2197da85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:37 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Volume f7ba050d-7f90-41c7-b8a6-8a853e7852f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6', 'volume_size': 1, 'snapshot_id': '1367c3d0-7fea-456f-8371-76a6e9dc73aa'}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-1367c3d0-7fea-456f-8371-76a6e9dc73aa-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" by "_create_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-1367c3d0-7fea-456f-8371-76a6e9dc73aa-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Creating volume f7ba050d-7f90-41c7-b8a6-8a853e7852f6 from snapshot 1367c3d0-7fea-456f-8371-76a6e9dc73aa {{(pid=82266) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] snapshot: 1367c3d0-7fea-456f-8371-76a6e9dc73aa, volume: f7ba050d-7f90-41c7-b8a6-8a853e7852f6,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[92929fdf-7fe7-4de7-bb89-8cce190bf7f9]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:38 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa
Apr 17 05:34:38 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:38 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa" returned: 0 in 0.466s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4bf92d-3d66-400f-9033-219f2e3ff9ad]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:38 devstack sudo[89353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b
Apr 17 05:34:38 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:38 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b" returned: 0 in 0.461s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6 not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:34:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:38 devstack sudo[89358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6
Apr 17 05:34:38 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:40 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" returned: 0 in 1.929s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:40 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[66224796-e414-4597-8bcc-c9f0c789d718]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:40 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b
Apr 17 05:34:40 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:41 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b" returned: 0 in 0.590s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6 {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:34:41 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Converted 1024.00 MB image at 530.44 MB/s
Apr 17 05:34:41 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6 is being set with open permissions: ugo+rw
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:41 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6
Apr 17 05:34:41 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:41 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" returned: 0 in 0.409s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" released by "_copy_volume_from_snapshot" :: held 3.911s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-1367c3d0-7fea-456f-8371-76a6e9dc73aa-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" released by "_create_volume_from_snapshot" :: held 3.928s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.936s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b66deb1-6a33-4a65-b892-d8a2197da85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6', 'volume_size': 1, 'snapshot_id': '1367c3d0-7fea-456f-8371-76a6e9dc73aa'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f9637f-6297-4521-aba3-10a5e3e7eb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:41 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Volume volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6 (f7ba050d-7f90-41c7-b8a6-8a853e7852f6): created successfully
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f9637f-6297-4521-aba3-10a5e3e7eb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Flow 'volume_create_manager' (0621df5b-9b07-458b-8ef2-469cdb2b4e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:41 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ce4bdd42-33f5-4370-a3f8-d08f19c5deaa tempest-VolumesSnapshotTestJSON-1524391743 None] Created volume successfully.
Apr 17 05:34:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-f7ba050d-7f90-41c7-b8a6-8a853e7852f6-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-f7ba050d-7f90-41c7-b8a6-8a853e7852f6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" acquired by "delete_volume" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:42 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a017f4c9-06d7-4d2a-9e07-56bfcff84dc7]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:42 devstack sudo[89378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6
Apr 17 05:34:42 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:42 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" returned: 0 in 0.468s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:42 devstack sudo[89383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6
Apr 17 05:34:42 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:43 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" returned: 0 in 0.409s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-f7ba050d-7f90-41c7-b8a6-8a853e7852f6" released by "delete_volume" :: held 0.904s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Created reservations ['f764c389-49af-4e3b-93e1-b3f5fc6bed41', '77e71153-1c94-4b8c-a142-56b6a3e9dd98', '1cda4393-61d5-4ad6-bdc2-d6147a020dfd', 'f0468503-89b3-43bf-ad76-803ea1bd507d'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:43 devstack sudo[89386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:34:43 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-1367c3d0-7fea-456f-8371-76a6e9dc73aa-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-1367c3d0-7fea-456f-8371-76a6e9dc73aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-7fed4159-a039-4fad-81fe-82c5e6a08c9b" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-7fed4159-a039-4fad-81fe-82c5e6a08c9b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-1367c3d0-7fea-456f-8371-76a6e9dc73aa" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-1367c3d0-7fea-456f-8371-76a6e9dc73aa" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Deleting offline snapshot 1367c3d0-7fea-456f-8371-76a6e9dc73aa of volume 7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] snapshot_file for this snap is: volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5042dfcb-836e-4fb1-bd80-31434210e10d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:43 devstack sudo[89388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa
Apr 17 05:34:43 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:43 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.438s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:34:43 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Deleted volume successfully.
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7269d59d-2f1a-4221-9797-db75517146dc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-f7ba050d-7f90-41c7-b8a6-8a853e7852f6-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:43 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa" returned: 0 in 0.464s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2543107f-ee60-4985-98c1-4098bba20878]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:43 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b
Apr 17 05:34:43 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:44 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b" returned: 0 in 0.466s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:44 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa
Apr 17 05:34:44 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:44 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa" returned: 0 in 0.451s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:44 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa
Apr 17 05:34:44 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:45 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b.1367c3d0-7fea-456f-8371-76a6e9dc73aa" returned: 0 in 0.418s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-1367c3d0-7fea-456f-8371-76a6e9dc73aa" released by "_delete_snapshot" :: held 1.849s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-7fed4159-a039-4fad-81fe-82c5e6a08c9b" released by "delete_snapshot" :: held 1.860s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Created reservations ['68c8f9fd-d874-42a6-be77-d6467d6c04e2', 'cc5f0720-6159-4cba-a0af-ab82d061d800', '16d4f273-5623-4eea-81d9-f98b629726b9', 'b31bbeb1-c5c2-4c14-8bea-8b9458ae4738'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:34:45 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Delete snapshot completed successfully.
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-92006fe0-42e9-46ff-837b-500fe27fcaef tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-1367c3d0-7fea-456f-8371-76a6e9dc73aa-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-7fed4159-a039-4fad-81fe-82c5e6a08c9b-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-7fed4159-a039-4fad-81fe-82c5e6a08c9b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-7fed4159-a039-4fad-81fe-82c5e6a08c9b" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-7fed4159-a039-4fad-81fe-82c5e6a08c9b" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9434e472-f3ed-4b72-80dc-52dbeeab3ff5]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:45 devstack sudo[89407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b
Apr 17 05:34:45 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:46 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b" returned: 0 in 0.466s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:46 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b
Apr 17 05:34:46 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:46 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7fed4159-a039-4fad-81fe-82c5e6a08c9b" returned: 0 in 0.411s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-7fed4159-a039-4fad-81fe-82c5e6a08c9b" released by "delete_volume" :: held 0.910s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Created reservations ['7a7df1ac-793a-44f9-ae55-7f107f7d5667', '919b20e4-ca16-407e-b23d-5774cc8e9050', '839b26c1-39c7-42d3-b1e0-71ebd3ffbcc8', 'cfe0320c-cc41-4f01-8c7c-2b7df0909340'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:46 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:34:46 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-a1facec6-5938-4aae-9484-4ee59f7da635-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-a1facec6-5938-4aae-9484-4ee59f7da635-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "cinder-quobyte-a1facec6-5938-4aae-9484-4ee59f7da635" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-a1facec6-5938-4aae-9484-4ee59f7da635" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5be0542-8ee0-497a-bab4-73d6a42faedf]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:46 devstack sudo[89425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635
Apr 17 05:34:46 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:46 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.439s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:34:46 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Deleted volume successfully.
Apr 17 05:34:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0b54cdb-90fb-4537-9edb-31634ea4fcbc tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-7fed4159-a039-4fad-81fe-82c5e6a08c9b-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:47 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635" returned: 0 in 0.482s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:47 devstack sudo[89432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635
Apr 17 05:34:47 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:47 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a1facec6-5938-4aae-9484-4ee59f7da635" returned: 0 in 0.419s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-quobyte-a1facec6-5938-4aae-9484-4ee59f7da635" released by "delete_volume" :: held 0.930s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Created reservations ['43139c89-5e65-4073-8ff9-bd3809260d53', 'a74607dc-da4d-47a8-9584-d1e228ea062d', 'a6c02149-c6fe-4566-ba06-be6e8e560bf3', 'bcd71f58-a5bb-468e-89c5-46618b64f688'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:47 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:34:47 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:48 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.427s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:48 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:34:48 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Deleted volume successfully.
Apr 17 05:34:48 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e0947a74-f968-4051-8e13-1eec12a2e830 tempest-VolumesSnapshotTestJSON-1524391743 None] Lock "cinder-a1facec6-5938-4aae-9484-4ee59f7da635-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (832ea16e-90ba-4bbf-bb72-d0005bb7e710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d2de8c-f4ee-423a-aeab-c1de1e3b1a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d2de8c-f4ee-423a-aeab-c1de1e3b1a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279895293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cda26d6-1083-432d-b6c0-09b851fa3150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:51Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9ffce8-58f8-4c73-baa0-2f08422c23a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9ffce8-58f8-4c73-baa0-2f08422c23a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f007e6a-f972-4422-9ecc-960f44d00979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f007e6a-f972-4422-9ecc-960f44d00979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cda26d6-1083-432d-b6c0-09b851fa3150', 'volume_name': 'volume-7cda26d6-1083-432d-b6c0-09b851fa3150', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b483e8d1-99d3-4c9b-baec-04c513ea3cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b483e8d1-99d3-4c9b-baec-04c513ea3cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f802852-81ee-4cee-b8f0-3cd3a51166b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:51 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume 7cda26d6-1083-432d-b6c0-09b851fa3150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cda26d6-1083-432d-b6c0-09b851fa3150', 'volume_size': 1}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279895293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cda26d6-1083-432d-b6c0-09b851fa3150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:51Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Creating volume 7cda26d6-1083-432d-b6c0-09b851fa3150 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:34:51 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:51 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150 1073741824
Apr 17 05:34:51 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:51 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150 1073741824" returned: 0 in 0.479s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:51 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150
Apr 17 05:34:51 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:52 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150" returned: 0 in 0.423s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f802852-81ee-4cee-b8f0-3cd3a51166b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cda26d6-1083-432d-b6c0-09b851fa3150', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0fba37-222e-41c4-9520-36f1b257b47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:52 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume volume-7cda26d6-1083-432d-b6c0-09b851fa3150 (7cda26d6-1083-432d-b6c0-09b851fa3150): created successfully
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0fba37-222e-41c4-9520-36f1b257b47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (832ea16e-90ba-4bbf-bb72-d0005bb7e710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:52 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-fd1f6dfd-7304-4844-97ab-8d8b05820304 tempest-CreateVolumesFromSnapshotTest-659637551 None] Created volume successfully.
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG oslo_service.periodic_task [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:52 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:34:52 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:53 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.412s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:53 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:34:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Creating offline snapshot d8c160ac-49e3-4592-82d6-7619096fb81b of volume 7cda26d6-1083-432d-b6c0-09b851fa3150 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:34:53 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c27d96-1fb3-42e1-80a1-3757ec5cf719]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:34:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:53 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150
Apr 17 05:34:53 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:54 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150" returned: 0 in 0.475s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:54 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b 1G
Apr 17 05:34:54 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:54 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b 1G" returned: 0 in 0.462s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cda26d6-1083-432d-b6c0-09b851fa3150 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:54 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cda26d6-1083-432d-b6c0-09b851fa3150 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b
Apr 17 05:34:54 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:54 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cda26d6-1083-432d-b6c0-09b851fa3150 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b" returned: 0 in 0.430s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:54 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b is being set with open permissions: ugo+rw
Apr 17 05:34:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:54 devstack sudo[89467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b
Apr 17 05:34:54 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:55 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b" returned: 0 in 0.424s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:55 devstack sudo[89470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.info
Apr 17 05:34:55 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:55 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.info" returned: 0 in 0.412s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:55 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.info is being set with open permissions: ugo+rw
Apr 17 05:34:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:55 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.info
Apr 17 05:34:55 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:56 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.info" returned: 0 in 0.421s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.679s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:56 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-0df4cfd7-95c5-4295-906a-c178a4facf6c tempest-CreateVolumesFromSnapshotTest-659637551 None] Create snapshot completed successfully
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (53eef753-a38b-4e33-94d0-c75f9bfa7e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b204f821-0220-4d52-9956-4d14852278c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b204f821-0220-4d52-9956-4d14852278c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-851105337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66595a1e-55b8-4580-955c-bbf62507a337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:57Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b07c5c0-dd00-4f35-b53c-9c778fae9723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b07c5c0-dd00-4f35-b53c-9c778fae9723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932cdf17-44ae-4135-b043-5fe2192fa880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932cdf17-44ae-4135-b043-5fe2192fa880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66595a1e-55b8-4580-955c-bbf62507a337', 'volume_name': 'volume-66595a1e-55b8-4580-955c-bbf62507a337', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2893b6bb-4369-4e5d-8a0c-abe722de2975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2893b6bb-4369-4e5d-8a0c-abe722de2975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde85623-c2ce-431f-91d0-3f1f66de0b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:56 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume 66595a1e-55b8-4580-955c-bbf62507a337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66595a1e-55b8-4580-955c-bbf62507a337', 'volume_size': 1}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-851105337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66595a1e-55b8-4580-955c-bbf62507a337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:57Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Creating volume 66595a1e-55b8-4580-955c-bbf62507a337 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:34:56 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:34:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:56 devstack sudo[89476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337 1073741824
Apr 17 05:34:56 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (a1003373-6f71-4846-82d2-4f6b5ed181e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e140ce23-6b23-4bbb-9f43-41382034d985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e140ce23-6b23-4bbb-9f43-41382034d985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775224948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebab578-17de-4f7d-ae74-3b77c9b8e1d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:57Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968cfe5a-0e32-42be-b0cd-b3f2faa5583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968cfe5a-0e32-42be-b0cd-b3f2faa5583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250f140c-e02f-4ee6-ab84-11ab649f18b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250f140c-e02f-4ee6-ab84-11ab649f18b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebab578-17de-4f7d-ae74-3b77c9b8e1d7', 'volume_name': 'volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d940a932-f84a-4fe8-9e0e-01319789f42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d940a932-f84a-4fe8-9e0e-01319789f42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f26cf1-50d9-4942-9452-7e711c24e227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume 2ebab578-17de-4f7d-ae74-3b77c9b8e1d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7', 'volume_size': 1}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (4903862a-3bb7-4b8e-b001-7818751a1566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f053280-b017-4f4a-9286-6d85aa90c812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f053280-b017-4f4a-9286-6d85aa90c812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1787902244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b57384-e219-4c39-bcac-f9f5fdb0ffee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:57Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56be502c-e5d9-4958-9cc3-db82c77b562e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56be502c-e5d9-4958-9cc3-db82c77b562e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aee3d0-1548-4bcb-b6b9-80f0676a53ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aee3d0-1548-4bcb-b6b9-80f0676a53ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b57384-e219-4c39-bcac-f9f5fdb0ffee', 'volume_name': 'volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323ce45c-d068-48a0-aa66-f4f5454c66c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323ce45c-d068-48a0-aa66-f4f5454c66c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d882474b-5d1c-452b-a5f0-22d3cb0c1f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume 03b57384-e219-4c39-bcac-f9f5fdb0ffee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee', 'volume_size': 1}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (ec8e0f2c-8a6e-4d3b-8f5e-80758870dec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29bc6aa-70b3-47ce-9cd2-268565935302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29bc6aa-70b3-47ce-9cd2-268565935302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1066712663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f40e6cc-0ac1-4935-977f-f75533acf89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:57Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4804d5d0-9550-42e4-82a0-0f2c3bfeea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4804d5d0-9550-42e4-82a0-0f2c3bfeea93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40499475-3734-491c-a178-8bf04fe8d397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40499475-3734-491c-a178-8bf04fe8d397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f40e6cc-0ac1-4935-977f-f75533acf89a', 'volume_name': 'volume-7f40e6cc-0ac1-4935-977f-f75533acf89a', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdd3ee1-15fb-49ae-985e-353b3cae103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdd3ee1-15fb-49ae-985e-353b3cae103a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097fe73c-89dc-46fc-b777-cbec0bff658d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume 7f40e6cc-0ac1-4935-977f-f75533acf89a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f40e6cc-0ac1-4935-977f-f75533acf89a', 'volume_size': 1}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337 1073741824" returned: 0 in 0.580s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:57 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337
Apr 17 05:34:57 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (30901bea-ad63-47aa-85ec-71c7b0189524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65aee63-a41a-4bc2-9192-f98e53b0dfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65aee63-a41a-4bc2-9192-f98e53b0dfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1656678854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8704184-f836-45e4-a8aa-4f29f3e9fe1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:58Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369ef89e-735a-4331-9957-77e4ee0f9599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369ef89e-735a-4331-9957-77e4ee0f9599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b192bb-2434-49ac-bc42-1564787c3f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b192bb-2434-49ac-bc42-1564787c3f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8704184-f836-45e4-a8aa-4f29f3e9fe1f', 'volume_name': 'volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de095f2-02c0-49a1-b711-3e70d4508c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de095f2-02c0-49a1-b711-3e70d4508c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa232f64-8f9b-439a-8373-23fcead1fa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume a8704184-f836-45e4-a8aa-4f29f3e9fe1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f', 'volume_size': 1}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:57 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337" returned: 0 in 0.407s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775224948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebab578-17de-4f7d-ae74-3b77c9b8e1d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:57Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Creating volume 2ebab578-17de-4f7d-ae74-3b77c9b8e1d7 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:34:57 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde85623-c2ce-431f-91d0-3f1f66de0b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66595a1e-55b8-4580-955c-bbf62507a337', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffa0f38-74e8-4f3e-bf19-1b480e5d7832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:57 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7 1073741824
Apr 17 05:34:57 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:57 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume volume-66595a1e-55b8-4580-955c-bbf62507a337 (66595a1e-55b8-4580-955c-bbf62507a337): created successfully
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffa0f38-74e8-4f3e-bf19-1b480e5d7832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:57 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (53eef753-a38b-4e33-94d0-c75f9bfa7e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:57 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-59d7785b-6f51-45b7-9f47-680726b4c782 tempest-CreateVolumesFromSnapshotTest-659637551 None] Created volume successfully.
Apr 17 05:34:58 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7 1073741824" returned: 0 in 0.486s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:58 devstack sudo[89490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7
Apr 17 05:34:58 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:58 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7" returned: 0 in 0.403s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.549s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1787902244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b57384-e219-4c39-bcac-f9f5fdb0ffee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:57Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Creating volume 03b57384-e219-4c39-bcac-f9f5fdb0ffee {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:34:58 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f26cf1-50d9-4942-9452-7e711c24e227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:58 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee 1073741824
Apr 17 05:34:58 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceee287-c080-4085-8eb1-4d4d63a32d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:58 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7 (2ebab578-17de-4f7d-ae74-3b77c9b8e1d7): created successfully
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceee287-c080-4085-8eb1-4d4d63a32d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:58 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (a1003373-6f71-4846-82d2-4f6b5ed181e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-98beeb5f-bf1a-439e-857b-e2390672eb8e tempest-CreateVolumesFromSnapshotTest-659637551 None] Created volume successfully.
Apr 17 05:34:59 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee 1073741824" returned: 0 in 0.491s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:59 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee
Apr 17 05:34:59 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:59 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee" returned: 0 in 0.402s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.274s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1066712663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f40e6cc-0ac1-4935-977f-f75533acf89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:57Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Creating volume 7f40e6cc-0ac1-4935-977f-f75533acf89a {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:34:59 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d882474b-5d1c-452b-a5f0-22d3cb0c1f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:59 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a 1073741824
Apr 17 05:34:59 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253ac2f7-93dc-475d-97ae-0200c0deb02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:34:59 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee (03b57384-e219-4c39-bcac-f9f5fdb0ffee): created successfully
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253ac2f7-93dc-475d-97ae-0200c0deb02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:34:59 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (4903862a-3bb7-4b8e-b001-7818751a1566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:34:59 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-8911ccf7-978d-4a5d-a3bc-327dc135c8fc tempest-CreateVolumesFromSnapshotTest-659637551 None] Created volume successfully.
Apr 17 05:35:00 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a 1073741824" returned: 0 in 0.483s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:00 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a
Apr 17 05:35:00 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:00 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a" returned: 0 in 0.405s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.010s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1656678854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8704184-f836-45e4-a8aa-4f29f3e9fe1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110c7ed6944a45949259caac01bd7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:34:58Z,use_quota=True,user_id='39c04126a03b4ea28294d221d1d157e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Creating volume a8704184-f836-45e4-a8aa-4f29f3e9fe1f {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:35:00 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:INSERT=21,cinder:UPDATE=92,cinder:SELECT=90,cinder:DELETE=11 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097fe73c-89dc-46fc-b777-cbec0bff658d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f40e6cc-0ac1-4935-977f-f75533acf89a', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:00 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f 1073741824
Apr 17 05:35:00 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c535cb1-55d3-4454-92f1-91b9245f6d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=84,cinder:INSERT=27,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:35:00 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume volume-7f40e6cc-0ac1-4935-977f-f75533acf89a (7f40e6cc-0ac1-4935-977f-f75533acf89a): created successfully
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c535cb1-55d3-4454-92f1-91b9245f6d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:00 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (ec8e0f2c-8a6e-4d3b-8f5e-80758870dec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:00 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9699a32b-9dd8-4729-b64c-0733bd60f4c5 tempest-CreateVolumesFromSnapshotTest-659637551 None] Created volume successfully.
Apr 17 05:35:01 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f 1073741824" returned: 0 in 0.482s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:01 devstack sudo[89514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f
Apr 17 05:35:01 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:01 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f" returned: 0 in 0.405s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:01 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:35:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa232f64-8f9b-439a-8373-23fcead1fa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fac15d6-a213-4fe3-ba2a-96fcbf65cbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:01 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Volume volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f (a8704184-f836-45e4-a8aa-4f29f3e9fe1f): created successfully
Apr 17 05:35:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fac15d6-a213-4fe3-ba2a-96fcbf65cbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:01 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Flow 'volume_create_manager' (30901bea-ad63-47aa-85ec-71c7b0189524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:01 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9e80f6aa-edec-4d38-a1d3-29a3e5301551 tempest-CreateVolumesFromSnapshotTest-659637551 None] Created volume successfully.
Apr 17 05:35:01 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-a8704184-f836-45e4-a8aa-4f29f3e9fe1f-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-a8704184-f836-45e4-a8aa-4f29f3e9fe1f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-quobyte-a8704184-f836-45e4-a8aa-4f29f3e9fe1f" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-a8704184-f836-45e4-a8aa-4f29f3e9fe1f" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:02 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[56712efb-6c5d-4eb1-9aa2-26ac9e736321]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:02 devstack sudo[89517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f
Apr 17 05:35:02 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:02 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f" returned: 0 in 0.485s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:02 devstack sudo[89522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f
Apr 17 05:35:02 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:02 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a8704184-f836-45e4-a8aa-4f29f3e9fe1f" returned: 0 in 0.425s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-a8704184-f836-45e4-a8aa-4f29f3e9fe1f" released by "delete_volume" :: held 0.933s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:02 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Created reservations ['86301d75-da1b-407b-ad0c-97de1a7be0b9', 'aa63ce39-184d-4b22-ba8d-b1e99886e1a3', '2ba71260-fa15-4188-80a4-034682ac08dd', 'e89e8fa3-a717-4335-9c77-50c2fbc1aa85'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:03 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:03 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-7f40e6cc-0ac1-4935-977f-f75533acf89a-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-7f40e6cc-0ac1-4935-977f-f75533acf89a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-quobyte-7f40e6cc-0ac1-4935-977f-f75533acf89a" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-7f40e6cc-0ac1-4935-977f-f75533acf89a" acquired by "delete_volume" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a916f08a-7322-4069-88d4-5afcfc280f9a]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:03 devstack sudo[89527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a
Apr 17 05:35:03 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:03 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.405s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:03 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Deleted volume successfully.
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-85785ce1-8d88-407b-b19d-03b71031612a tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-a8704184-f836-45e4-a8aa-4f29f3e9fe1f-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:03 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a" returned: 0 in 0.491s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:03 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a
Apr 17 05:35:03 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:04 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7f40e6cc-0ac1-4935-977f-f75533acf89a" returned: 0 in 0.400s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-7f40e6cc-0ac1-4935-977f-f75533acf89a" released by "delete_volume" :: held 0.913s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Created reservations ['8b338337-390c-49ae-a033-c4c9d1707da8', '40129a75-c74f-48a5-a5ff-2901f97db6d4', 'c633e760-ae2a-4600-9897-c88767129769', 'b808a78a-c1f9-4b01-b51b-51fa068da5f4'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:04 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:04 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-03b57384-e219-4c39-bcac-f9f5fdb0ffee-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-03b57384-e219-4c39-bcac-f9f5fdb0ffee-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-quobyte-03b57384-e219-4c39-bcac-f9f5fdb0ffee" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-03b57384-e219-4c39-bcac-f9f5fdb0ffee" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef086c05-b6bb-4b1a-b276-cf7f86aee8e4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:04 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee
Apr 17 05:35:04 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:04 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.439s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:04 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Deleted volume successfully.
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0a610ee9-0c50-424c-83b8-452d7d983519 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-7f40e6cc-0ac1-4935-977f-f75533acf89a-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:04 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee" returned: 0 in 0.497s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:04 devstack sudo[89578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee
Apr 17 05:35:04 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:05 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-03b57384-e219-4c39-bcac-f9f5fdb0ffee" returned: 0 in 0.428s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-03b57384-e219-4c39-bcac-f9f5fdb0ffee" released by "delete_volume" :: held 0.947s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Created reservations ['097eb4f3-aa2a-4f75-a791-faf7c1710041', '39b3d31b-7337-4e46-a056-a978567445df', '3afd461c-2076-42a6-be20-46c539401c0f', '1bdab292-9345-43d9-a21f-818432631eb6'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:05 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:05 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-quobyte-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34875af-6431-4608-b765-21397421e887]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:05 devstack sudo[89584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7
Apr 17 05:35:05 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:05 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.433s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:05 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Deleted volume successfully.
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-72473354-7c51-4ca8-a4f1-4fa19da34945 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-03b57384-e219-4c39-bcac-f9f5fdb0ffee-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:05 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7" returned: 0 in 0.468s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:05 devstack sudo[89590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7
Apr 17 05:35:05 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:06 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7" returned: 0 in 0.424s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7" released by "delete_volume" :: held 0.913s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Created reservations ['3df190e9-eba6-4da9-8681-6c4e864da902', '666b1ead-65db-412b-9a50-cbd6a3de8c00', '0d41064f-8e08-441d-86f1-c25ab5acd511', 'd2ac67af-b0f7-4d06-8755-8e2e30b5301c'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:06 devstack sudo[89593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:06 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-66595a1e-55b8-4580-955c-bbf62507a337-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-66595a1e-55b8-4580-955c-bbf62507a337-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-quobyte-66595a1e-55b8-4580-955c-bbf62507a337" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-66595a1e-55b8-4580-955c-bbf62507a337" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b0a0c3-9fae-4fc5-b7ac-845aa79f27c2]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:06 devstack sudo[89595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337
Apr 17 05:35:06 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:06 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.438s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Deleted volume successfully.
Apr 17 05:35:06 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-11505f0e-4ecb-48e6-8aaf-6e5fc3b936a1 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-2ebab578-17de-4f7d-ae74-3b77c9b8e1d7-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:07 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337" returned: 0 in 0.483s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:07 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337
Apr 17 05:35:07 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:07 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-66595a1e-55b8-4580-955c-bbf62507a337" returned: 0 in 0.403s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-66595a1e-55b8-4580-955c-bbf62507a337" released by "delete_volume" :: held 0.907s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Created reservations ['6026fc6c-cd51-416b-8e15-fb2f19846537', '9470b5cb-378b-48d7-8c61-3779f8b5e228', '2945e78f-89a0-412e-ba12-cff34791cffe', '6b9098e5-73af-46cf-bbc8-3f8c3dd95772'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:07 devstack sudo[89605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:07 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-d8c160ac-49e3-4592-82d6-7619096fb81b-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-d8c160ac-49e3-4592-82d6-7619096fb81b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-quobyte-7cda26d6-1083-432d-b6c0-09b851fa3150" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-7cda26d6-1083-432d-b6c0-09b851fa3150" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-quobyte-d8c160ac-49e3-4592-82d6-7619096fb81b" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-d8c160ac-49e3-4592-82d6-7619096fb81b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Deleting offline snapshot d8c160ac-49e3-4592-82d6-7619096fb81b of volume 7cda26d6-1083-432d-b6c0-09b851fa3150 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] snapshot_file for this snap is: volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7901f07f-39f1-48d8-bdde-5f8492bde243]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:07 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b
Apr 17 05:35:07 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:07 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.407s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:07 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Deleted volume successfully.
Apr 17 05:35:07 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-aae905a8-3279-4c7a-a154-577037dd9cad tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-66595a1e-55b8-4580-955c-bbf62507a337-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:08 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b" returned: 0 in 0.480s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cda26d6-1083-432d-b6c0-09b851fa3150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:35:08 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb033f-36d8-4fa7-ba00-8e890ffa1dd1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:08 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150
Apr 17 05:35:08 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:08 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150" returned: 0 in 0.455s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:08 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b
Apr 17 05:35:08 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:09 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b" returned: 0 in 0.428s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:09 devstack sudo[89623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b
Apr 17 05:35:09 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:09 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150.d8c160ac-49e3-4592-82d6-7619096fb81b" returned: 0 in 0.435s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-d8c160ac-49e3-4592-82d6-7619096fb81b" released by "_delete_snapshot" :: held 1.849s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-7cda26d6-1083-432d-b6c0-09b851fa3150" released by "delete_snapshot" :: held 1.859s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Created reservations ['4bd3d2ae-5b25-463d-b32e-87f306250025', '1e861300-1046-46a8-9db9-fd0338dca3d1', 'a08d60a3-45d8-426e-b78d-cbf2816cad1d', '6b3703ba-2a84-4412-9a27-f8264ad2f624'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:09 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Delete snapshot completed successfully.
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5293c9b5-f58b-4f9f-8364-5c4f73bd577f tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-d8c160ac-49e3-4592-82d6-7619096fb81b-delete_snapshot" released by "delete_snapshot" :: held 1.938s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-7cda26d6-1083-432d-b6c0-09b851fa3150-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-7cda26d6-1083-432d-b6c0-09b851fa3150-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "cinder-quobyte-7cda26d6-1083-432d-b6c0-09b851fa3150" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-7cda26d6-1083-432d-b6c0-09b851fa3150" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f35bb-d393-4b36-aa88-f7e39577a47d]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:09 devstack sudo[89626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150
Apr 17 05:35:09 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:10 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:10 devstack sudo[89631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150
Apr 17 05:35:10 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:10 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7cda26d6-1083-432d-b6c0-09b851fa3150" returned: 0 in 0.410s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-quobyte-7cda26d6-1083-432d-b6c0-09b851fa3150" released by "delete_volume" :: held 0.907s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Created reservations ['aee6c52c-230d-41e7-bea0-611998b6dd51', 'e888bd55-e561-48ae-acc2-4f9ec07e1ff8', '856d8dec-7f20-41f5-866a-237dfce3391b', '82e2f07b-0952-435b-99c8-88710034f750'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:10 devstack sudo[89634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:10 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:11 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.466s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:11 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:11 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Deleted volume successfully.
Apr 17 05:35:11 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e65821f5-e251-48d5-a059-685dfd77aa85 tempest-CreateVolumesFromSnapshotTest-659637551 None] Lock "cinder-7cda26d6-1083-432d-b6c0-09b851fa3150-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (27a8fc33-d30d-49b8-9d2f-a449b6d43a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84646d82-a7ff-47d8-95da-afa086c0a6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84646d82-a7ff-47d8-95da-afa086c0a6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1938254889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96849522-fd3b-4898-b4ab-5ce2f5ab5550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:12Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b743eb8c-afc7-490c-b8d7-becb6d8f8ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b743eb8c-afc7-490c-b8d7-becb6d8f8ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (315c3e5a-7345-4a64-9861-97904411fc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (315c3e5a-7345-4a64-9861-97904411fc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96849522-fd3b-4898-b4ab-5ce2f5ab5550', 'volume_name': 'volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a201820-6fd4-489f-97e1-b9532a71e54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a201820-6fd4-489f-97e1-b9532a71e54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ea15c3-469a-4d94-873c-e972d967b75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:12 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume 96849522-fd3b-4898-b4ab-5ce2f5ab5550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550', 'volume_size': 1}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1938254889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96849522-fd3b-4898-b4ab-5ce2f5ab5550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:12Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Creating volume 96849522-fd3b-4898-b4ab-5ce2f5ab5550 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:35:12 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:12 devstack sudo[89637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550 1073741824
Apr 17 05:35:12 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:12 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550 1073741824" returned: 0 in 0.459s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:12 devstack sudo[89642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550
Apr 17 05:35:12 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:13 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:35:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ea15c3-469a-4d94-873c-e972d967b75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfd853e-8a06-4382-97d2-96a5811ee668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:13 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550 (96849522-fd3b-4898-b4ab-5ce2f5ab5550): created successfully
Apr 17 05:35:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfd853e-8a06-4382-97d2-96a5811ee668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:13 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (27a8fc33-d30d-49b8-9d2f-a449b6d43a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:13 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f14c7922-ba7b-4f7a-b209-cf11f8cc388c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created volume successfully.
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (b3c34d6d-f404-4a3a-9b3b-04352abddbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b864673-d0a7-4113-b3b4-57ca7dbc9207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b864673-d0a7-4113-b3b4-57ca7dbc9207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-489042030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebca0a07-0686-4f29-9657-e44e3965b650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:15Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3f034e-bdb6-4684-ad23-1abf33885908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3f034e-bdb6-4684-ad23-1abf33885908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28109e06-7622-409b-91b6-2ee99569d05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28109e06-7622-409b-91b6-2ee99569d05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebca0a07-0686-4f29-9657-e44e3965b650', 'volume_name': 'volume-ebca0a07-0686-4f29-9657-e44e3965b650', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8885ed83-919b-4414-a905-f647df433ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8885ed83-919b-4414-a905-f647df433ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7539ab99-2bfa-42e6-944f-58fef05df220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:14 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume ebca0a07-0686-4f29-9657-e44e3965b650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebca0a07-0686-4f29-9657-e44e3965b650', 'volume_size': 1}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-489042030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebca0a07-0686-4f29-9657-e44e3965b650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:15Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Creating volume ebca0a07-0686-4f29-9657-e44e3965b650 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:35:14 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:14 devstack sudo[89645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650 1073741824
Apr 17 05:35:14 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (c21c11c6-8752-4c3d-a52a-9286b9546bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2ff71c-a83e-485f-85ef-6f445b685fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2ff71c-a83e-485f-85ef-6f445b685fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1511995626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23549858-ab09-4756-ba9d-98c9a1c5c81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:15Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ac3860-27f6-4445-bfb2-9e303fca9735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ac3860-27f6-4445-bfb2-9e303fca9735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1ab315-9552-470c-9789-a3fffe10b3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1ab315-9552-470c-9789-a3fffe10b3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23549858-ab09-4756-ba9d-98c9a1c5c81e', 'volume_name': 'volume-23549858-ab09-4756-ba9d-98c9a1c5c81e', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eef53cc-3a1f-452e-9889-0dc2b37b91b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eef53cc-3a1f-452e-9889-0dc2b37b91b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2c1d2a-82fa-4c95-b49b-aa625cbb4b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:14 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume 23549858-ab09-4756-ba9d-98c9a1c5c81e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23549858-ab09-4756-ba9d-98c9a1c5c81e', 'volume_size': 1}
Apr 17 05:35:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (380bf6d8-dfdc-4ac2-bcfe-bf17658f8151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0962013f-b007-46c2-8bc9-6a93a7970196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0962013f-b007-46c2-8bc9-6a93a7970196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-444629742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2fa163-520f-4426-b8ca-40b370271d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:15Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0910ad-1148-48d8-835f-9c59169022c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0910ad-1148-48d8-835f-9c59169022c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ba52b6-9801-4a5e-8c58-917750611f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ba52b6-9801-4a5e-8c58-917750611f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2fa163-520f-4426-b8ca-40b370271d46', 'volume_name': 'volume-5e2fa163-520f-4426-b8ca-40b370271d46', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb06f29-ac99-4368-9931-b86d081bd1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb06f29-ac99-4368-9931-b86d081bd1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcde7aa-e44d-42f1-9ff5-0c1be25dbd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume 5e2fa163-520f-4426-b8ca-40b370271d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2fa163-520f-4426-b8ca-40b370271d46', 'volume_size': 1}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:35:15 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (cd1b7c88-c737-443b-8553-72b72f239b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fd00c4-4215-4c9e-9829-54c0b7dd78fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650 1073741824" returned: 0 in 0.563s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fd00c4-4215-4c9e-9829-54c0b7dd78fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-307797378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d213fe6a-0ea6-4533-8002-8985257acfdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:15Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e271e2-a8ed-48ba-8f80-f74e66e3cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e271e2-a8ed-48ba-8f80-f74e66e3cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe21a3e3-c40d-42d0-93eb-84f92860420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe21a3e3-c40d-42d0-93eb-84f92860420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd213fe6a-0ea6-4533-8002-8985257acfdc', 'volume_name': 'volume-d213fe6a-0ea6-4533-8002-8985257acfdc', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b69892-dabc-4e69-8f6d-b3ee7661e61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b69892-dabc-4e69-8f6d-b3ee7661e61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497cf501-24fb-4077-a2e6-d2cdf92c7769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume d213fe6a-0ea6-4533-8002-8985257acfdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d213fe6a-0ea6-4533-8002-8985257acfdc', 'volume_size': 1}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:15 devstack sudo[89650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650
Apr 17 05:35:15 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (f5bb851d-d04c-42b6-9788-1b6d0951a1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb754eb-1a9c-4088-b0a9-d0e24cba7022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb754eb-1a9c-4088-b0a9-d0e24cba7022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2036229151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e30a984-dc39-45bc-aa42-f730e261fc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:15Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccbebeb-c190-4075-b8f9-35d62a6e1040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccbebeb-c190-4075-b8f9-35d62a6e1040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436084bb-62d0-473b-94e3-04d829dfd41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436084bb-62d0-473b-94e3-04d829dfd41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e30a984-dc39-45bc-aa42-f730e261fc48', 'volume_name': 'volume-2e30a984-dc39-45bc-aa42-f730e261fc48', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da9359d-c1e7-43bc-aab2-3219b6d0f3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da9359d-c1e7-43bc-aab2-3219b6d0f3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f152e2-e0bf-4b1a-a669-0f980d179762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume 2e30a984-dc39-45bc-aa42-f730e261fc48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e30a984-dc39-45bc-aa42-f730e261fc48', 'volume_size': 1}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:15 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650" returned: 0 in 0.413s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1511995626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23549858-ab09-4756-ba9d-98c9a1c5c81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:15Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Creating volume 23549858-ab09-4756-ba9d-98c9a1c5c81e {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:35:15 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7539ab99-2bfa-42e6-944f-58fef05df220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebca0a07-0686-4f29-9657-e44e3965b650', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack sudo[89653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e 1073741824
Apr 17 05:35:15 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74d0d4b-0d4a-47af-83c6-cca81d13932b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:15 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume volume-ebca0a07-0686-4f29-9657-e44e3965b650 (ebca0a07-0686-4f29-9657-e44e3965b650): created successfully
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74d0d4b-0d4a-47af-83c6-cca81d13932b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (b3c34d6d-f404-4a3a-9b3b-04352abddbce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:15 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a2a366cd-f14f-4a04-a564-ebb528a5c738 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created volume successfully.
Apr 17 05:35:16 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e 1073741824" returned: 0 in 0.482s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:16 devstack sudo[89658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e
Apr 17 05:35:16 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:16 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e" returned: 0 in 0.438s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.620s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-444629742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2fa163-520f-4426-b8ca-40b370271d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:15Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Creating volume 5e2fa163-520f-4426-b8ca-40b370271d46 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:35:16 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2c1d2a-82fa-4c95-b49b-aa625cbb4b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23549858-ab09-4756-ba9d-98c9a1c5c81e', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:16 devstack sudo[89661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46 1073741824
Apr 17 05:35:16 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8319ee96-04d7-46df-86c9-1df291ff8226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:16 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume volume-23549858-ab09-4756-ba9d-98c9a1c5c81e (23549858-ab09-4756-ba9d-98c9a1c5c81e): created successfully
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8319ee96-04d7-46df-86c9-1df291ff8226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:16 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (c21c11c6-8752-4c3d-a52a-9286b9546bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:16 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c5e2e6f9-7d4a-4308-9650-abbe2949ff89 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created volume successfully.
Apr 17 05:35:17 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46 1073741824" returned: 0 in 0.487s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:17 devstack sudo[89667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46
Apr 17 05:35:17 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:17 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46" returned: 0 in 0.426s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.321s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-307797378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d213fe6a-0ea6-4533-8002-8985257acfdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:15Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Creating volume d213fe6a-0ea6-4533-8002-8985257acfdc {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:35:17 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcde7aa-e44d-42f1-9ff5-0c1be25dbd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2fa163-520f-4426-b8ca-40b370271d46', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:17 devstack sudo[89670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc 1073741824
Apr 17 05:35:17 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e650acf-954d-4587-8ca2-6fa4f2f88955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:17 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume volume-5e2fa163-520f-4426-b8ca-40b370271d46 (5e2fa163-520f-4426-b8ca-40b370271d46): created successfully
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e650acf-954d-4587-8ca2-6fa4f2f88955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:17 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (380bf6d8-dfdc-4ac2-bcfe-bf17658f8151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:17 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-77da7d53-0e39-4693-96a4-bf884125c4b1 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created volume successfully.
Apr 17 05:35:18 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc 1073741824" returned: 0 in 0.468s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:18 devstack sudo[89675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc
Apr 17 05:35:18 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:18 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc" returned: 0 in 0.403s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.058s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2036229151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e30a984-dc39-45bc-aa42-f730e261fc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc22c9d7979b430b944e78b096a5efef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:15Z,use_quota=True,user_id='95ba19f476d84c2f8f1e2e1c08111069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Creating volume 2e30a984-dc39-45bc-aa42-f730e261fc48 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:35:18 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497cf501-24fb-4077-a2e6-d2cdf92c7769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d213fe6a-0ea6-4533-8002-8985257acfdc', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:18 devstack sudo[89678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48 1073741824
Apr 17 05:35:18 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b99734-9ce5-4de8-917a-993b6a77db29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:18 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume volume-d213fe6a-0ea6-4533-8002-8985257acfdc (d213fe6a-0ea6-4533-8002-8985257acfdc): created successfully
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b99734-9ce5-4de8-917a-993b6a77db29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:18 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (cd1b7c88-c737-443b-8553-72b72f239b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:18 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-aebb6d1d-eb18-4b11-90b5-34ed2379bf2c tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created volume successfully.
Apr 17 05:35:19 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48 1073741824" returned: 0 in 0.468s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:19 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48
Apr 17 05:35:19 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:19 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48" returned: 0 in 0.423s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f152e2-e0bf-4b1a-a669-0f980d179762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e30a984-dc39-45bc-aa42-f730e261fc48', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab62ad51-5b04-4ca8-beee-c7429d06aa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:19 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Volume volume-2e30a984-dc39-45bc-aa42-f730e261fc48 (2e30a984-dc39-45bc-aa42-f730e261fc48): created successfully
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab62ad51-5b04-4ca8-beee-c7429d06aa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Flow 'volume_create_manager' (f5bb851d-d04c-42b6-9788-1b6d0951a1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:19 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-863cb86f-2e55-4f94-9cf6-77df845270b7 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created volume successfully.
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-2e30a984-dc39-45bc-aa42-f730e261fc48-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-2e30a984-dc39-45bc-aa42-f730e261fc48-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-quobyte-2e30a984-dc39-45bc-aa42-f730e261fc48" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-2e30a984-dc39-45bc-aa42-f730e261fc48" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[441f1196-6b3b-4ee3-9d71-7d59f9241d34]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:19 devstack sudo[89686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48
Apr 17 05:35:19 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:20 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48" returned: 0 in 0.457s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:20 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48
Apr 17 05:35:20 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:20 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2e30a984-dc39-45bc-aa42-f730e261fc48" returned: 0 in 0.403s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-2e30a984-dc39-45bc-aa42-f730e261fc48" released by "delete_volume" :: held 0.882s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created reservations ['e3f47c4b-e692-441c-a9d4-134bc27a1a8d', '37357588-744d-43c4-b454-89d608cf0ad6', '90fd6390-76e7-48b0-b86b-8985c634ae51', '00e74acc-1ee7-4b14-a45a-9e86c0580664'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:20 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:20 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:20 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-d213fe6a-0ea6-4533-8002-8985257acfdc-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-d213fe6a-0ea6-4533-8002-8985257acfdc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-quobyte-d213fe6a-0ea6-4533-8002-8985257acfdc" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-d213fe6a-0ea6-4533-8002-8985257acfdc" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ce12ee-f119-4b99-8d04-408ee77c430e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:21 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc
Apr 17 05:35:21 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:21 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.415s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:21 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Deleted volume successfully.
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-423d4553-ba4e-433e-978e-a3949815edb3 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-2e30a984-dc39-45bc-aa42-f730e261fc48-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:21 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc" returned: 0 in 0.489s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:21 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc
Apr 17 05:35:21 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:21 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-d213fe6a-0ea6-4533-8002-8985257acfdc" returned: 0 in 0.409s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-d213fe6a-0ea6-4533-8002-8985257acfdc" released by "delete_volume" :: held 0.930s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:21 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created reservations ['f938da0d-fbde-4997-b200-707669b0d64e', 'e23f4878-15bb-4496-8c8d-5aabdc69e89e', 'c4fd78a7-fe1e-40bb-8164-73293485fd04', 'e444c716-df5f-4460-80b8-0468a1a84144'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:22 devstack sudo[89706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:22 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-5e2fa163-520f-4426-b8ca-40b370271d46-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-5e2fa163-520f-4426-b8ca-40b370271d46-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-quobyte-5e2fa163-520f-4426-b8ca-40b370271d46" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-5e2fa163-520f-4426-b8ca-40b370271d46" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7b069f-8e89-4770-ae0d-845947fb6d74]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:22 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46
Apr 17 05:35:22 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:22 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.422s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:22 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Deleted volume successfully.
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9e24f3d8-640a-48db-98c5-805a91d47132 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-d213fe6a-0ea6-4533-8002-8985257acfdc-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:22 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46" returned: 0 in 0.483s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:22 devstack sudo[89714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46
Apr 17 05:35:22 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:23 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-5e2fa163-520f-4426-b8ca-40b370271d46" returned: 0 in 0.414s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-5e2fa163-520f-4426-b8ca-40b370271d46" released by "delete_volume" :: held 0.928s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created reservations ['1e1283e6-f9ee-405d-9cbd-5ec8dfe322e7', 'c92e4edd-c591-4958-9276-f97f38924814', '8184a439-6dcc-4e69-a72e-fb25aedbd064', 'cc33c454-5c83-4f40-b014-b9c7c2bdb362'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:23 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:23 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-23549858-ab09-4756-ba9d-98c9a1c5c81e-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-23549858-ab09-4756-ba9d-98c9a1c5c81e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-quobyte-23549858-ab09-4756-ba9d-98c9a1c5c81e" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-23549858-ab09-4756-ba9d-98c9a1c5c81e" acquired by "delete_volume" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f035d3cc-382e-4860-b70c-5430cba67152]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:23 devstack sudo[89719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e
Apr 17 05:35:23 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:23 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.430s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:23 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Deleted volume successfully.
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-0d41b3c3-2e60-4369-9e40-54c79b246ecf tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-5e2fa163-520f-4426-b8ca-40b370271d46-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:23 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:23 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e
Apr 17 05:35:23 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:24 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-23549858-ab09-4756-ba9d-98c9a1c5c81e" returned: 0 in 0.405s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-23549858-ab09-4756-ba9d-98c9a1c5c81e" released by "delete_volume" :: held 0.896s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created reservations ['a7accd51-b894-48e4-a06e-84cfb4101cbd', '8d50a349-822f-469e-b14d-ad7004d39ef1', '853fb3f9-e46e-49cf-b89f-e2bbc9ca3049', 'dd86f6e9-5fa0-42d5-87cf-2d8fbea9958f'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:24 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:24 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-ebca0a07-0686-4f29-9657-e44e3965b650-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-ebca0a07-0686-4f29-9657-e44e3965b650-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-quobyte-ebca0a07-0686-4f29-9657-e44e3965b650" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-ebca0a07-0686-4f29-9657-e44e3965b650" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc3e238-22c0-42dc-a929-75f2cf2a6a06]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:24 devstack sudo[89730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650
Apr 17 05:35:24 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:24 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.453s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:24 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Deleted volume successfully.
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-f91758ed-2db0-4067-abad-fc80978ec8fa tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-23549858-ab09-4756-ba9d-98c9a1c5c81e-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:24 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650" returned: 0 in 0.464s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:24 devstack sudo[89736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650
Apr 17 05:35:24 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:25 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ebca0a07-0686-4f29-9657-e44e3965b650" returned: 0 in 0.422s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-ebca0a07-0686-4f29-9657-e44e3965b650" released by "delete_volume" :: held 0.917s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created reservations ['fb055798-5ef4-4452-aae2-f8312f813477', '5ebb312f-1c0b-4d8a-a424-c7c693be8afc', '846e8559-1246-4263-980a-4e5e209d65ce', 'dd5e880f-5c62-4bbf-89da-c11775e098e3'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:25 devstack sudo[89739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:25 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-96849522-fd3b-4898-b4ab-5ce2f5ab5550-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-96849522-fd3b-4898-b4ab-5ce2f5ab5550-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "cinder-quobyte-96849522-fd3b-4898-b4ab-5ce2f5ab5550" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-96849522-fd3b-4898-b4ab-5ce2f5ab5550" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8995ca-9a4a-4db7-9988-e33727fe506b]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:25 devstack sudo[89741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550
Apr 17 05:35:25 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:25 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.449s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:25 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Deleted volume successfully.
Apr 17 05:35:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-26e53409-0624-49c8-b0c7-4d3e3d52803a tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-ebca0a07-0686-4f29-9657-e44e3965b650-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:26 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550" returned: 0 in 0.461s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:26 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550
Apr 17 05:35:26 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:26 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-96849522-fd3b-4898-b4ab-5ce2f5ab5550" returned: 0 in 0.408s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-quobyte-96849522-fd3b-4898-b4ab-5ce2f5ab5550" released by "delete_volume" :: held 0.890s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Created reservations ['251c4a5c-9e70-4815-a095-2340e264fe9c', '6cec09f9-c6c7-4659-884d-00b43be3b684', 'f31e0405-5367-4fc7-8a1e-bb13575056e4', 'cae85722-9c6e-49e8-8abe-40051e9cc233'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:26 devstack sudo[89750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:26 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:26 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.449s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:26 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Deleted volume successfully.
Apr 17 05:35:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ea622d24-d9d7-4e59-93b0-5fa172bbb684 tempest-CreateVolumesFromSourceVolumeTest-1843423976 None] Lock "cinder-96849522-fd3b-4898-b4ab-5ce2f5ab5550-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Flow 'volume_create_manager' (34d8ef4c-efb2-4aef-93d6-97a40be23375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206c9867-5306-471a-bb15-9b78f535d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206c9867-5306-471a-bb15-9b78f535d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-250348658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b4d84e4b754a8ba9964b58dc41a805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:28Z,use_quota=True,user_id='33aad1934b774d08b99a7035dc1cbf14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aac8f60-3e00-4d74-9616-5abd385ee772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aac8f60-3e00-4d74-9616-5abd385ee772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfd0b36-0928-40e2-acad-804d9fd4e6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfd0b36-0928-40e2-acad-804d9fd4e6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1', 'volume_name': 'volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600871ea-5487-4527-8244-0770d05073dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600871ea-5487-4527-8244-0770d05073dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbe890a-ec9c-4d2b-9841-29f88a9865e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:28 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Volume 8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1', 'volume_size': 1}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-250348658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b4d84e4b754a8ba9964b58dc41a805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:28Z,use_quota=True,user_id='33aad1934b774d08b99a7035dc1cbf14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Creating volume 8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:35:28 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:28 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 1073741824
Apr 17 05:35:28 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:28 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 1073741824" returned: 0 in 0.474s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:28 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1
Apr 17 05:35:28 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:29 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" returned: 0 in 0.412s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:35:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbe890a-ec9c-4d2b-9841-29f88a9865e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c1b19b-4d69-49a6-abae-c2f60f2ad40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:29 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Volume volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 (8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1): created successfully
Apr 17 05:35:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c1b19b-4d69-49a6-abae-c2f60f2ad40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Flow 'volume_create_manager' (34d8ef4c-efb2-4aef-93d6-97a40be23375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:29 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-a63b5df5-4dd3-451c-8ab2-861c7937f3bf tempest-VolumeDependencyTests-1590110426 None] Created volume successfully.
Apr 17 05:35:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:30 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Creating offline snapshot e42d6588-eefa-4f43-b0ec-ed2a29096f17 of volume 8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:35:30 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[583e5129-6729-4d52-8367-97b502480b94]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:30 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1
Apr 17 05:35:30 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:30 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" returned: 0 in 0.482s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:30 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 1G
Apr 17 05:35:30 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:31 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 1G" returned: 0 in 0.457s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:31 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17
Apr 17 05:35:31 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:31 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17" returned: 0 in 0.434s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:31 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 is being set with open permissions: ugo+rw
Apr 17 05:35:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:31 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17
Apr 17 05:35:31 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:32 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17" returned: 0 in 0.406s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:32 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.info
Apr 17 05:35:32 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:32 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.info" returned: 0 in 0.406s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:32 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.info is being set with open permissions: ugo+rw
Apr 17 05:35:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:32 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.info
Apr 17 05:35:32 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:33 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.info" returned: 0 in 0.430s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.670s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-78a33cc7-e1a0-4b2d-9095-db8093260f26 tempest-VolumeDependencyTests-1590110426 None] Create snapshot completed successfully
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Flow 'volume_create_manager' (512208ba-dcbc-43ef-bdcf-fa050c9e7a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95263b0-51b3-4f35-ade8-e29b21314a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95263b0-51b3-4f35-ade8-e29b21314a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-519678522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28618b2e-be18-4d42-b00d-54bbfe487024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b4d84e4b754a8ba9964b58dc41a805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e42d6588-eefa-4f43-b0ec-ed2a29096f17,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:34Z,use_quota=True,user_id='33aad1934b774d08b99a7035dc1cbf14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081360a1-17ea-4112-97c4-362d6378273f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081360a1-17ea-4112-97c4-362d6378273f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fadac67-e8fa-4632-847e-3cff47a25282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fadac67-e8fa-4632-847e-3cff47a25282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28618b2e-be18-4d42-b00d-54bbfe487024', 'volume_name': 'volume-28618b2e-be18-4d42-b00d-54bbfe487024', 'volume_size': 1, 'snapshot_id': 'e42d6588-eefa-4f43-b0ec-ed2a29096f17'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f52c6a0-6ae6-4824-a284-ab3cb6979303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f52c6a0-6ae6-4824-a284-ab3cb6979303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db579bd7-0c69-4c04-a81a-863e308a6231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:33 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Volume 28618b2e-be18-4d42-b00d-54bbfe487024: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28618b2e-be18-4d42-b00d-54bbfe487024', 'volume_size': 1, 'snapshot_id': 'e42d6588-eefa-4f43-b0ec-ed2a29096f17'}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-quobyte-e42d6588-eefa-4f43-b0ec-ed2a29096f17-28618b2e-be18-4d42-b00d-54bbfe487024" by "_create_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-e42d6588-eefa-4f43-b0ec-ed2a29096f17-28618b2e-be18-4d42-b00d-54bbfe487024" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Creating volume 28618b2e-be18-4d42-b00d-54bbfe487024 from snapshot e42d6588-eefa-4f43-b0ec-ed2a29096f17 {{(pid=82266) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-quobyte-28618b2e-be18-4d42-b00d-54bbfe487024" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-28618b2e-be18-4d42-b00d-54bbfe487024" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] snapshot: e42d6588-eefa-4f43-b0ec-ed2a29096f17, volume: 28618b2e-be18-4d42-b00d-54bbfe487024,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bee2be9-0ade-433b-86e4-033c6439bc3a]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:33 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17
Apr 17 05:35:33 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:34 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17" returned: 0 in 0.483s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:35:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:35:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:35:34 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[498404a4-50ae-4654-853a-81c5e693dd97]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:34 devstack sudo[89791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1
Apr 17 05:35:34 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:34 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:34 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024 not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:35:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:34 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024
Apr 17 05:35:34 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:36 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024" returned: 0 in 1.931s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:36 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e466d09d-a927-4ea4-b46d-cd6a87ba1299]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:36 devstack sudo[89808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1
Apr 17 05:35:36 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:37 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" returned: 0 in 0.597s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024 {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:35:37 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Converted 1024.00 MB image at 529.84 MB/s
Apr 17 05:35:37 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024 is being set with open permissions: ugo+rw
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:37 devstack sudo[89814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024
Apr 17 05:35:37 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:37 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024" returned: 0 in 0.414s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-28618b2e-be18-4d42-b00d-54bbfe487024" released by "_copy_volume_from_snapshot" :: held 3.945s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-e42d6588-eefa-4f43-b0ec-ed2a29096f17-28618b2e-be18-4d42-b00d-54bbfe487024" released by "_create_volume_from_snapshot" :: held 3.958s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.965s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db579bd7-0c69-4c04-a81a-863e308a6231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28618b2e-be18-4d42-b00d-54bbfe487024', 'volume_size': 1, 'snapshot_id': 'e42d6588-eefa-4f43-b0ec-ed2a29096f17'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f72249-13c4-4a1f-9469-18c8cbca81cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:37 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Volume volume-28618b2e-be18-4d42-b00d-54bbfe487024 (28618b2e-be18-4d42-b00d-54bbfe487024): created successfully
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f72249-13c4-4a1f-9469-18c8cbca81cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Flow 'volume_create_manager' (512208ba-dcbc-43ef-bdcf-fa050c9e7a0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:37 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-fce540f7-5cc0-42b4-991f-91e1c9c03796 tempest-VolumeDependencyTests-1590110426 None] Created volume successfully.
Apr 17 05:35:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-e42d6588-eefa-4f43-b0ec-ed2a29096f17-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-e42d6588-eefa-4f43-b0ec-ed2a29096f17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-quobyte-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-quobyte-e42d6588-eefa-4f43-b0ec-ed2a29096f17" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-e42d6588-eefa-4f43-b0ec-ed2a29096f17" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Deleting offline snapshot e42d6588-eefa-4f43-b0ec-ed2a29096f17 of volume 8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] snapshot_file for this snap is: volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ca63c9-bdf1-43b5-927f-1e91844ddd88]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:38 devstack sudo[89817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17
Apr 17 05:35:38 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:38 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17" returned: 0 in 0.457s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4fde06-f41d-47c4-b661-80ee3dc9bc2c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:38 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1
Apr 17 05:35:38 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:38 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" returned: 0 in 0.452s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:38 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17
Apr 17 05:35:38 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:39 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17" returned: 0 in 0.442s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:39 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17
Apr 17 05:35:39 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:39 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1.e42d6588-eefa-4f43-b0ec-ed2a29096f17" returned: 0 in 0.427s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-e42d6588-eefa-4f43-b0ec-ed2a29096f17" released by "_delete_snapshot" :: held 1.832s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" released by "delete_snapshot" :: held 1.843s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:39 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Created reservations ['fd310f86-c2b6-46bb-bb9d-712865196228', '3cead9e9-1820-47da-85e3-99d7ded9b89b', '518aa7de-ac0c-4279-b14b-04c125156390', '4322e19f-5608-4340-b49d-db787038d0e4'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:39 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Delete snapshot completed successfully.
Apr 17 05:35:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b91b94ed-5a01-4987-98b3-69a25a8ff42c tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-e42d6588-eefa-4f43-b0ec-ed2a29096f17-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-quobyte-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:40 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2324c0-625a-481a-8541-1411a1c657b6]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:40 devstack sudo[89835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1
Apr 17 05:35:40 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:40 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" returned: 0 in 0.488s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:40 devstack sudo[89840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1
Apr 17 05:35:40 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:41 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" returned: 0 in 0.400s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1" released by "delete_volume" :: held 0.916s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Created reservations ['56b05043-fced-4768-9df2-d9c1af4b3473', 'e1118415-5166-43be-8b17-7ec3e812d96b', '8bd1ca34-d427-4892-804d-a918cd9a6cd1', '92c77f3f-fad3-4868-9c9c-e497bedda943'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:41 devstack sudo[89843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:41 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Flow 'volume_create_manager' (8c143150-6ba2-4ed2-a03c-5872528b971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e614ad5-7c79-41f0-8769-97b028ea86d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e614ad5-7c79-41f0-8769-97b028ea86d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1473208111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98744f0-c49d-4a1c-8e07-e20757e0ecc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b4d84e4b754a8ba9964b58dc41a805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:41Z,use_quota=True,user_id='33aad1934b774d08b99a7035dc1cbf14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed381c5-1945-406c-ac83-d765645aa139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed381c5-1945-406c-ac83-d765645aa139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8098c88-eede-4e00-a873-591b3ef23520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8098c88-eede-4e00-a873-591b3ef23520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98744f0-c49d-4a1c-8e07-e20757e0ecc2', 'volume_name': 'volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743f948a-7f14-4995-b586-e0c4734651db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743f948a-7f14-4995-b586-e0c4734651db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6b1e62-2307-4234-8ea2-10dbc6b5fded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:41 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Volume f98744f0-c49d-4a1c-8e07-e20757e0ecc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2', 'volume_size': 1}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1473208111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98744f0-c49d-4a1c-8e07-e20757e0ecc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b4d84e4b754a8ba9964b58dc41a805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:41Z,use_quota=True,user_id='33aad1934b774d08b99a7035dc1cbf14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Creating volume f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:35:41 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:41 devstack sudo[89846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 1073741824
Apr 17 05:35:41 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:41 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.427s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:41 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Deleted volume successfully.
Apr 17 05:35:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3a533007-f975-43c1-8a36-55ef029a47cf tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-8884aa6b-98e1-4d49-9eb5-5a8038e0a8b1-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:42 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 1073741824" returned: 0 in 0.495s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:42 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2
Apr 17 05:35:42 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:42 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2" returned: 0 in 0.409s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:35:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6b1e62-2307-4234-8ea2-10dbc6b5fded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca07cad-f7c3-4e83-9ce6-5fa0d6708210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:42 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Volume volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 (f98744f0-c49d-4a1c-8e07-e20757e0ecc2): created successfully
Apr 17 05:35:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca07cad-f7c3-4e83-9ce6-5fa0d6708210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:42 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Flow 'volume_create_manager' (8c143150-6ba2-4ed2-a03c-5872528b971e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:42 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-27568cef-c43c-46d6-bea0-16c46b83ab9b tempest-VolumeDependencyTests-1590110426 None] Created volume successfully.
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Flow 'volume_create_manager' (cddb51fe-c80b-4463-adb6-7074592de695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84408cc-167a-4fca-8f20-c6564e4f3a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84408cc-167a-4fca-8f20-c6564e4f3a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1288511368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016e9d73-db2f-43eb-aaef-3c908d56c038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b4d84e4b754a8ba9964b58dc41a805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f98744f0-c49d-4a1c-8e07-e20757e0ecc2,status='creating',terminated_at=None,updated_at=2026-04-17T03:35:44Z,use_quota=True,user_id='33aad1934b774d08b99a7035dc1cbf14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a05ee48-db7f-4833-8179-ca7f6e0a3d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a05ee48-db7f-4833-8179-ca7f6e0a3d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5119125-d81d-4960-878a-55c83e918e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5119125-d81d-4960-878a-55c83e918e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '016e9d73-db2f-43eb-aaef-3c908d56c038', 'volume_name': 'volume-016e9d73-db2f-43eb-aaef-3c908d56c038', 'volume_size': 1, 'source_volid': 'f98744f0-c49d-4a1c-8e07-e20757e0ecc2', 'source_volstatus': 'available'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4812283d-0687-44f4-8766-f3d82e060740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4812283d-0687-44f4-8766-f3d82e060740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d998c82-0e83-450c-8838-c6d4d3d9cc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:43 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Volume 016e9d73-db2f-43eb-aaef-3c908d56c038: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-016e9d73-db2f-43eb-aaef-3c908d56c038', 'volume_size': 1, 'source_volid': 'f98744f0-c49d-4a1c-8e07-e20757e0ecc2', 'source_volstatus': 'available'}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:43 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Cloning volume f98744f0-c49d-4a1c-8e07-e20757e0ecc2 to volume 016e9d73-db2f-43eb-aaef-3c908d56c038
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Creating offline snapshot 75c5fc65-3209-400f-a3a4-d630fec87a7e of volume f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccdec65-f879-4a04-8f6a-a80a258fcadb]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:43 devstack sudo[89854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2
Apr 17 05:35:43 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:44 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2" returned: 0 in 0.466s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:44 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e 1G
Apr 17 05:35:44 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:44 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e 1G" returned: 0 in 0.458s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:44 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e
Apr 17 05:35:44 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:45 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e" returned: 0 in 0.434s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:45 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e is being set with open permissions: ugo+rw
Apr 17 05:35:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:45 devstack sudo[89869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e
Apr 17 05:35:45 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:45 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:45 devstack sudo[89874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.info
Apr 17 05:35:45 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:46 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.info" returned: 0 in 0.399s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:46 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.info is being set with open permissions: ugo+rw
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:46 devstack sudo[89877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.info
Apr 17 05:35:46 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:46 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.info" returned: 0 in 0.411s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-quobyte-016e9d73-db2f-43eb-aaef-3c908d56c038" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-016e9d73-db2f-43eb-aaef-3c908d56c038" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] snapshot: 75c5fc65-3209-400f-a3a4-d630fec87a7e, volume: 016e9d73-db2f-43eb-aaef-3c908d56c038,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[977ea4dd-cf0b-45ed-8fc5-8b34d3e780a1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:46 devstack sudo[89880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e
Apr 17 05:35:46 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:47 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e" returned: 0 in 0.479s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:35:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:35:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:35:47 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da9db0-7fd8-40a3-8976-6152c6e87baf]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:47 devstack sudo[89891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2
Apr 17 05:35:47 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:47 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2" returned: 0 in 0.462s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:47 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038 not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:35:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:47 devstack sudo[89897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038
Apr 17 05:35:47 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:49 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038" returned: 0 in 2.020s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:49 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[42293175-961a-49d0-9603-83d32d2a38b6]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:49 devstack sudo[89909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2
Apr 17 05:35:49 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:50 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2" returned: 0 in 0.598s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038 {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:35:50 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Converted 1024.00 MB image at 506.55 MB/s
Apr 17 05:35:50 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038 is being set with open permissions: ugo+rw
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:50 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038
Apr 17 05:35:50 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:50 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038" returned: 0 in 0.415s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-016e9d73-db2f-43eb-aaef-3c908d56c038" released by "_copy_volume_from_snapshot" :: held 4.019s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-quobyte-75c5fc65-3209-400f-a3a4-d630fec87a7e" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-75c5fc65-3209-400f-a3a4-d630fec87a7e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Deleting offline snapshot 75c5fc65-3209-400f-a3a4-d630fec87a7e of volume f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] snapshot_file for this snap is: volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1019639b-6a02-4711-a9c0-72d317f8d789]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:50 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e
Apr 17 05:35:50 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:51 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e" returned: 0 in 0.470s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:35:51 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[52922e96-7f1b-4ab2-860b-61c954bcf875]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:51 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2
Apr 17 05:35:51 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:51 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:51 devstack sudo[89927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e
Apr 17 05:35:51 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:51 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e" returned: 0 in 0.453s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:52 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e
Apr 17 05:35:52 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:52 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2.75c5fc65-3209-400f-a3a4-d630fec87a7e" returned: 0 in 0.421s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-75c5fc65-3209-400f-a3a4-d630fec87a7e" released by "_delete_snapshot" :: held 1.858s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.568s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d998c82-0e83-450c-8838-c6d4d3d9cc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016e9d73-db2f-43eb-aaef-3c908d56c038', 'volume_size': 1, 'source_volid': 'f98744f0-c49d-4a1c-8e07-e20757e0ecc2', 'source_volstatus': 'available'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7764904-3e71-4c8b-b923-56a47bb4f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:35:52 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Volume volume-016e9d73-db2f-43eb-aaef-3c908d56c038 (016e9d73-db2f-43eb-aaef-3c908d56c038): created successfully
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7764904-3e71-4c8b-b923-56a47bb4f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Flow 'volume_create_manager' (cddb51fe-c80b-4463-adb6-7074592de695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:35:52 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c346a0a2-d5e3-4fec-bad7-e2df147dd3c2 tempest-VolumeDependencyTests-1590110426 None] Created volume successfully.
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG oslo_service.periodic_task [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:52 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:52 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:53 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:53 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-f98744f0-c49d-4a1c-8e07-e20757e0ecc2-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-f98744f0-c49d-4a1c-8e07-e20757e0ecc2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-quobyte-f98744f0-c49d-4a1c-8e07-e20757e0ecc2" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:53 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-f98744f0-c49d-4a1c-8e07-e20757e0ecc2" acquired by "delete_volume" :: waited 0.006s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:53 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c738724a-78cf-48d3-b19b-858349bc1ca7]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:53 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2
Apr 17 05:35:53 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:53 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2" returned: 0 in 0.469s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:53 devstack sudo[89943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2
Apr 17 05:35:53 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:54 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f98744f0-c49d-4a1c-8e07-e20757e0ecc2" returned: 0 in 0.437s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-f98744f0-c49d-4a1c-8e07-e20757e0ecc2" released by "delete_volume" :: held 0.934s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Created reservations ['f8d53932-7a24-4e06-9f17-807c7bb912d7', 'ebf2de9a-2c67-4b39-9dbe-0f2944feda1d', '80a2e6bc-0031-4656-b16e-3c4177f6e75f', 'e141bc60-a4e8-4958-b771-dede906f2ac8'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:54 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:54 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-016e9d73-db2f-43eb-aaef-3c908d56c038-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-016e9d73-db2f-43eb-aaef-3c908d56c038-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-quobyte-016e9d73-db2f-43eb-aaef-3c908d56c038" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-016e9d73-db2f-43eb-aaef-3c908d56c038" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[68065515-3b32-4923-9d23-de204791ea24]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:54 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038
Apr 17 05:35:54 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:54 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.450s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:54 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Deleted volume successfully.
Apr 17 05:35:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d5bc63d3-2c66-43cc-b68a-d798d060fbf5 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-f98744f0-c49d-4a1c-8e07-e20757e0ecc2-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:55 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:55 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038
Apr 17 05:35:55 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:55 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-016e9d73-db2f-43eb-aaef-3c908d56c038" returned: 0 in 0.421s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-016e9d73-db2f-43eb-aaef-3c908d56c038" released by "delete_volume" :: held 0.913s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Created reservations ['5a325734-6146-4674-9ae7-aca1a05b0f06', '9661ed7b-c764-47d9-8387-dfdf484e7df5', 'c48db93a-48cf-46ff-895a-9559e5a41350', '0ad80f20-4b41-45e9-8397-7b82a8369c39'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:55 devstack sudo[89957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:55 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-28618b2e-be18-4d42-b00d-54bbfe487024-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-28618b2e-be18-4d42-b00d-54bbfe487024-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "cinder-quobyte-28618b2e-be18-4d42-b00d-54bbfe487024" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-28618b2e-be18-4d42-b00d-54bbfe487024" acquired by "delete_volume" :: waited 0.021s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0668af6f-a346-43f7-b917-d3b178ecaf81]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:55 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024
Apr 17 05:35:55 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:55 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.418s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:55 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Deleted volume successfully.
Apr 17 05:35:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6d2d8c8f-fe8f-49a7-841a-79c9376ea78e tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-016e9d73-db2f-43eb-aaef-3c908d56c038-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:56 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024" returned: 0 in 0.485s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:56 devstack sudo[89965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024
Apr 17 05:35:56 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:56 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-28618b2e-be18-4d42-b00d-54bbfe487024" returned: 0 in 0.408s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-quobyte-28618b2e-be18-4d42-b00d-54bbfe487024" released by "delete_volume" :: held 0.913s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Created reservations ['3908536c-0a29-4ad4-8dd2-cbce204dc082', '4465640f-a70e-4220-a73d-4461c50e4270', '748263cb-6aae-41e6-b78c-7f5f2ca9727d', '9788a621-1f90-4a29-b1c2-f2a0056789c7'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:35:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:35:56 devstack sudo[89968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:35:56 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:35:57 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root
Apr 17 05:35:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.451s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:35:57 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:35:57 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Deleted volume successfully.
Apr 17 05:35:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-3551a4a5-e540-47aa-8208-0989fa5c0063 tempest-VolumeDependencyTests-1590110426 None] Lock "cinder-28618b2e-be18-4d42-b00d-54bbfe487024-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:UPDATE=165,cinder:DELETE=17,cinder:SELECT=118,cinder:INSERT=39 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=121,cinder:UPDATE=184,cinder:INSERT=46,cinder:DELETE=12 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Flow 'volume_create_manager' (1dafb475-80fc-44ff-8b4c-72fee3ba6cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c2e780-a0a6-403c-bbc0-b127b069234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c2e780-a0a6-403c-bbc0-b127b069234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2034328624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7d784c-4230-4cf5-a685-ca94075ec206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf04075510da461aa8c934a9d4490908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:04Z,use_quota=True,user_id='18da1b80c28742cb819d2fb8ce78713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5446912d-c4e1-4b43-af15-2d4524b9679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5446912d-c4e1-4b43-af15-2d4524b9679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f52c2a-8957-420f-b7af-2e5842881182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f52c2a-8957-420f-b7af-2e5842881182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a7d784c-4230-4cf5-a685-ca94075ec206', 'volume_name': 'volume-1a7d784c-4230-4cf5-a685-ca94075ec206', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd02110-7232-4ad7-ab23-404ac5585938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd02110-7232-4ad7-ab23-404ac5585938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f646c531-106a-4fd0-ada7-26f4ca79e587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:03 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Volume 1a7d784c-4230-4cf5-a685-ca94075ec206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a7d784c-4230-4cf5-a685-ca94075ec206', 'volume_size': 1}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2034328624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7d784c-4230-4cf5-a685-ca94075ec206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf04075510da461aa8c934a9d4490908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:04Z,use_quota=True,user_id='18da1b80c28742cb819d2fb8ce78713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Creating volume 1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:03 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:04 devstack sudo[90015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 1073741824
Apr 17 05:36:04 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Flow 'volume_create_manager' (2c593df5-7f15-4166-bdcd-399b2ed79395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd0b788-f52f-4541-8f27-1a2047a413cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd0b788-f52f-4541-8f27-1a2047a413cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-811545067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355fd99b-0240-46ce-9096-465d97859f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4e0ecda358475fb640b317679e14b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:04Z,use_quota=True,user_id='87eae56a88d8427a89e9ffc75d8e6771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610d8c70-3901-430f-9282-c58c3f929038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610d8c70-3901-430f-9282-c58c3f929038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbffb8bf-7ceb-45a3-9c9e-c2172469ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbffb8bf-7ceb-45a3-9c9e-c2172469ed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355fd99b-0240-46ce-9096-465d97859f40', 'volume_name': 'volume-355fd99b-0240-46ce-9096-465d97859f40', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0baa063-d261-450b-890d-3d4c3ec8c591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0baa063-d261-450b-890d-3d4c3ec8c591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9035fae6-b26d-48e8-9fde-e59ccd39f226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Volume 355fd99b-0240-46ce-9096-465d97859f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355fd99b-0240-46ce-9096-465d97859f40', 'volume_size': 1}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Flow 'volume_create_manager' (9063aa1d-6ad2-4ecd-9a45-d068833d616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5217b6-09ef-4668-9915-936d7a2771ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5217b6-09ef-4668-9915-936d7a2771ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2129371903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7194764f-5fe9-4cad-b814-500c9f5b2c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4e0ecda358475fb640b317679e14b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:04Z,use_quota=True,user_id='87eae56a88d8427a89e9ffc75d8e6771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748f22a6-4713-4bfe-b11d-f29077c73aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748f22a6-4713-4bfe-b11d-f29077c73aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e45c18b-ea7b-4d00-a1d8-62188c478254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e45c18b-ea7b-4d00-a1d8-62188c478254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7194764f-5fe9-4cad-b814-500c9f5b2c36', 'volume_name': 'volume-7194764f-5fe9-4cad-b814-500c9f5b2c36', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bf5946-1b3e-428d-a580-bc953fd4add9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bf5946-1b3e-428d-a580-bc953fd4add9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50840296-71ca-4edf-af4d-f9de62366e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Volume 7194764f-5fe9-4cad-b814-500c9f5b2c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7194764f-5fe9-4cad-b814-500c9f5b2c36', 'volume_size': 1}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (3cbcfe45-6672-44dd-8f33-fd9745f687af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8648a3c-5c0a-45e2-b962-f9aa0a022084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8648a3c-5c0a-45e2-b962-f9aa0a022084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1872539647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2627c9-9add-471e-8e8d-4bf687572a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:04Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad44dda-5990-4826-8bc4-5f281c4c0f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad44dda-5990-4826-8bc4-5f281c4c0f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cea8695-a539-4972-a2d0-15cb6f22ef3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cea8695-a539-4972-a2d0-15cb6f22ef3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2627c9-9add-471e-8e8d-4bf687572a1f', 'volume_name': 'volume-8f2627c9-9add-471e-8e8d-4bf687572a1f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f0261e-a5f2-480f-85a9-574418eee218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f0261e-a5f2-480f-85a9-574418eee218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a61ea3-6d97-43dc-b5b4-10ad7f43175e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume 8f2627c9-9add-471e-8e8d-4bf687572a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2627c9-9add-471e-8e8d-4bf687572a1f', 'volume_size': 1}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Flow 'volume_create_manager' (e8e07015-216d-46cc-97fb-109d0f6372f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1aaf04-fce1-4596-bd37-b41ae51d09b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1aaf04-fce1-4596-bd37-b41ae51d09b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-738051286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b324c4-72d4-46b2-9557-327be84464f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4e0ecda358475fb640b317679e14b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:04Z,use_quota=True,user_id='87eae56a88d8427a89e9ffc75d8e6771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3446251d-a7c6-45ba-b30e-ceff39d1ade9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3446251d-a7c6-45ba-b30e-ceff39d1ade9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dea5989-7158-4487-8723-467e9f9f2d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dea5989-7158-4487-8723-467e9f9f2d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b324c4-72d4-46b2-9557-327be84464f2', 'volume_name': 'volume-73b324c4-72d4-46b2-9557-327be84464f2', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7fc73b-a139-4d5c-8fb2-9ae616bea64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7fc73b-a139-4d5c-8fb2-9ae616bea64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0b236f-6d7b-4626-9261-449a27e91549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Volume 73b324c4-72d4-46b2-9557-327be84464f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b324c4-72d4-46b2-9557-327be84464f2', 'volume_size': 1}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Flow 'volume_create_manager' (a29a7266-3956-473f-88a9-125daaa3687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1ae465-0e02-4aea-af3b-b5d21cd54fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1ae465-0e02-4aea-af3b-b5d21cd54fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99784014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f367d97b-aef4-4e11-86a5-fd8c09099ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4e0ecda358475fb640b317679e14b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:05Z,use_quota=True,user_id='87eae56a88d8427a89e9ffc75d8e6771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb908d0-fc2e-4afb-a4e1-ecab7bc266e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb908d0-fc2e-4afb-a4e1-ecab7bc266e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd93756b-a064-4927-a6e3-510a5e314767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd93756b-a064-4927-a6e3-510a5e314767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f367d97b-aef4-4e11-86a5-fd8c09099ff8', 'volume_name': 'volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a40d4e-8ce4-4796-bbc7-c38dffab1105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a40d4e-8ce4-4796-bbc7-c38dffab1105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c761e4d2-c1bb-49d2-be65-397ab468aea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Volume f367d97b-aef4-4e11-86a5-fd8c09099ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8', 'volume_size': 1}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:04 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 1073741824" returned: 0 in 0.804s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:04 devstack sudo[90054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206
Apr 17 05:36:04 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Flow 'volume_create_manager' (d304ed32-ccee-4385-95f6-958fad9180d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce96828-d4c0-425e-8b02-75b6f5e52532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce96828-d4c0-425e-8b02-75b6f5e52532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-985668397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbba6802-a215-4d39-9712-aa747926d95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4e0ecda358475fb640b317679e14b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:05Z,use_quota=True,user_id='87eae56a88d8427a89e9ffc75d8e6771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68c1494-7f41-4512-9b36-5313f5352efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68c1494-7f41-4512-9b36-5313f5352efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84584e3-270a-4134-a69f-ebf8b57122b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84584e3-270a-4134-a69f-ebf8b57122b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbba6802-a215-4d39-9712-aa747926d95b', 'volume_name': 'volume-cbba6802-a215-4d39-9712-aa747926d95b', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c755ec19-b1fc-4787-be81-3640ed8cf854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c755ec19-b1fc-4787-be81-3640ed8cf854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccba1447-f571-4963-9aa1-eaaac987edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:04 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Volume cbba6802-a215-4d39-9712-aa747926d95b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbba6802-a215-4d39-9712-aa747926d95b', 'volume_size': 1}
Apr 17 05:36:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:05 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206" returned: 0 in 0.448s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-811545067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355fd99b-0240-46ce-9096-465d97859f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4e0ecda358475fb640b317679e14b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:04Z,use_quota=True,user_id='87eae56a88d8427a89e9ffc75d8e6771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Creating volume 355fd99b-0240-46ce-9096-465d97859f40 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:05 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f646c531-106a-4fd0-ada7-26f4ca79e587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7d784c-4230-4cf5-a685-ca94075ec206', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:05 devstack sudo[90057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40 1073741824
Apr 17 05:36:05 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8d07b9-6a3e-4368-a799-a67f2f9803e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:05 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Volume volume-1a7d784c-4230-4cf5-a685-ca94075ec206 (1a7d784c-4230-4cf5-a685-ca94075ec206): created successfully
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8d07b9-6a3e-4368-a799-a67f2f9803e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Flow 'volume_create_manager' (1dafb475-80fc-44ff-8b4c-72fee3ba6cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:05 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-800de979-1dc8-4e48-90bc-4227c0bae999 tempest-VolumeDependencyTests-381097656 None] Created volume successfully.
Apr 17 05:36:05 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40 1073741824" returned: 0 in 0.525s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:05 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:05 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40
Apr 17 05:36:05 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:06 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40" returned: 0 in 0.522s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.104s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2129371903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7194764f-5fe9-4cad-b814-500c9f5b2c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4e0ecda358475fb640b317679e14b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:04Z,use_quota=True,user_id='87eae56a88d8427a89e9ffc75d8e6771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Creating volume 7194764f-5fe9-4cad-b814-500c9f5b2c36 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:06 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9035fae6-b26d-48e8-9fde-e59ccd39f226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355fd99b-0240-46ce-9096-465d97859f40', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:06 devstack sudo[90066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36 1073741824
Apr 17 05:36:06 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0eb19f-f4dd-447f-8642-c41908bf59a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:06 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Volume volume-355fd99b-0240-46ce-9096-465d97859f40 (355fd99b-0240-46ce-9096-465d97859f40): created successfully
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0eb19f-f4dd-447f-8642-c41908bf59a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Flow 'volume_create_manager' (2c593df5-7f15-4166-bdcd-399b2ed79395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:06 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ce7a4e4c-af10-45e4-b410-65348fc67fb0 tempest-CreateVolumesFromImageTest-2105451086 None] Created volume successfully.
Apr 17 05:36:06 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36 1073741824" returned: 0 in 0.563s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:06 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:06 devstack sudo[90071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36
Apr 17 05:36:06 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:07 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36" returned: 0 in 0.501s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.155s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1872539647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2627c9-9add-471e-8e8d-4bf687572a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:04Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Creating volume 8f2627c9-9add-471e-8e8d-4bf687572a1f {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:07 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50840296-71ca-4edf-af4d-f9de62366e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7194764f-5fe9-4cad-b814-500c9f5b2c36', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ed112c-4d48-49b6-9548-cb45ec9a07c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:07 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f 1073741824
Apr 17 05:36:07 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:07 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Volume volume-7194764f-5fe9-4cad-b814-500c9f5b2c36 (7194764f-5fe9-4cad-b814-500c9f5b2c36): created successfully
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ed112c-4d48-49b6-9548-cb45ec9a07c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Flow 'volume_create_manager' (9063aa1d-6ad2-4ecd-9a45-d068833d616d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:07 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-33cf56ba-ff0e-4d00-8ea3-1c3cc5dd4b04 tempest-CreateVolumesFromImageTest-2105451086 None] Created volume successfully.
Apr 17 05:36:07 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:07 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f 1073741824" returned: 0 in 0.552s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:08 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f
Apr 17 05:36:08 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:08 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f" returned: 0 in 0.446s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.136s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-738051286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b324c4-72d4-46b2-9557-327be84464f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4e0ecda358475fb640b317679e14b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:04Z,use_quota=True,user_id='87eae56a88d8427a89e9ffc75d8e6771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Creating volume 73b324c4-72d4-46b2-9557-327be84464f2 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:08 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a61ea3-6d97-43dc-b5b4-10ad7f43175e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2627c9-9add-471e-8e8d-4bf687572a1f', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3498063-3073-4682-a74b-3d985f4d6c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:08 devstack sudo[90083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2 1073741824
Apr 17 05:36:08 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:08 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume volume-8f2627c9-9add-471e-8e8d-4bf687572a1f (8f2627c9-9add-471e-8e8d-4bf687572a1f): created successfully
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3498063-3073-4682-a74b-3d985f4d6c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (3cbcfe45-6672-44dd-8f33-fd9745f687af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:08 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-72be4de9-203f-43a4-b006-c7aae1488307 tempest-CreateVolumesFromSnapshotTest-625778028 None] Created volume successfully.
Apr 17 05:36:08 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2 1073741824" returned: 0 in 0.504s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:08 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:09 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2
Apr 17 05:36:09 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:09 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2" returned: 0 in 0.530s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.869s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99784014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f367d97b-aef4-4e11-86a5-fd8c09099ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4e0ecda358475fb640b317679e14b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:05Z,use_quota=True,user_id='87eae56a88d8427a89e9ffc75d8e6771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Creating volume f367d97b-aef4-4e11-86a5-fd8c09099ff8 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:09 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0b236f-6d7b-4626-9261-449a27e91549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b324c4-72d4-46b2-9557-327be84464f2', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:09 devstack sudo[90091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8 1073741824
Apr 17 05:36:09 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b59b993-6135-4aeb-beeb-f21214dafed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:09 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Volume volume-73b324c4-72d4-46b2-9557-327be84464f2 (73b324c4-72d4-46b2-9557-327be84464f2): created successfully
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b59b993-6135-4aeb-beeb-f21214dafed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:09 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Flow 'volume_create_manager' (e8e07015-216d-46cc-97fb-109d0f6372f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:09 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-24859625-6a56-44b6-8a3f-a32ffe26bdb2 tempest-CreateVolumesFromImageTest-2105451086 None] Created volume successfully.
Apr 17 05:36:10 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8 1073741824" returned: 0 in 0.526s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:10 devstack sudo[90096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8
Apr 17 05:36:10 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:10 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8" returned: 0 in 0.519s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.730s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-985668397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbba6802-a215-4d39-9712-aa747926d95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4e0ecda358475fb640b317679e14b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:05Z,use_quota=True,user_id='87eae56a88d8427a89e9ffc75d8e6771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Creating volume cbba6802-a215-4d39-9712-aa747926d95b {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:10 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c761e4d2-c1bb-49d2-be65-397ab468aea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:10 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b 1073741824
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c6c861-fc3c-4747-860b-b885aa2d174b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:10 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:10 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Volume volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8 (f367d97b-aef4-4e11-86a5-fd8c09099ff8): created successfully
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c6c861-fc3c-4747-860b-b885aa2d174b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:10 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Flow 'volume_create_manager' (a29a7266-3956-473f-88a9-125daaa3687e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:10 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1783d659-b14e-489f-9809-a5967631ccc3 tempest-CreateVolumesFromImageTest-2105451086 None] Created volume successfully.
Apr 17 05:36:11 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b 1073741824" returned: 0 in 0.616s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:11 devstack sudo[90104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b
Apr 17 05:36:11 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:11 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b" returned: 0 in 0.462s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.472s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Creating offline snapshot 517c41ae-7da8-4859-8581-995418af3e5f of volume 1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccba1447-f571-4963-9aa1-eaaac987edef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbba6802-a215-4d39-9712-aa747926d95b', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a94a70-60f6-479e-b43c-356303c3f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b66b7f-4de7-412d-a0d9-4aa4761ed232]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:11 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Volume volume-cbba6802-a215-4d39-9712-aa747926d95b (cbba6802-a215-4d39-9712-aa747926d95b): created successfully
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a94a70-60f6-479e-b43c-356303c3f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:11 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Flow 'volume_create_manager' (d304ed32-ccee-4385-95f6-958fad9180d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:11 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-3a85f79f-4580-49cd-b9d0-e424855a59fc tempest-CreateVolumesFromImageTest-2105451086 None] Created volume successfully.
Apr 17 05:36:11 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206
Apr 17 05:36:11 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:12 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206" returned: 0 in 0.523s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:12 devstack sudo[90112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f 1G
Apr 17 05:36:12 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "cinder-cbba6802-a215-4d39-9712-aa747926d95b-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-cbba6802-a215-4d39-9712-aa747926d95b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "cinder-quobyte-cbba6802-a215-4d39-9712-aa747926d95b" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:12 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-quobyte-cbba6802-a215-4d39-9712-aa747926d95b" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:12 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b3b026-5ecb-408a-a52c-19ce6c178b87]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:12 devstack sudo[90114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b
Apr 17 05:36:12 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:12 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f 1G" returned: 0 in 0.544s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:12 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7d784c-4230-4cf5-a685-ca94075ec206 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:12 devstack sudo[90119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7d784c-4230-4cf5-a685-ca94075ec206 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f
Apr 17 05:36:12 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:13 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b" returned: 0 in 0.553s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:13 devstack sudo[90124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b
Apr 17 05:36:13 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:13 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7d784c-4230-4cf5-a685-ca94075ec206 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f" returned: 0 in 0.473s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:13 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f is being set with open permissions: ugo+rw
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:13 devstack sudo[90129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f
Apr 17 05:36:13 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:13 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-cbba6802-a215-4d39-9712-aa747926d95b" returned: 0 in 0.446s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-quobyte-cbba6802-a215-4d39-9712-aa747926d95b" released by "delete_volume" :: held 1.023s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Created reservations ['4f3904eb-da1a-44eb-93e3-0f4250566a2c', '12ed9104-39f6-4a43-9c28-14d4cdc94c79', 'c6697638-ad10-486c-9463-4125031216db', '86f8157e-33d3-4d46-9d56-ae8a20be0c10'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:13 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:13 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:13 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f" returned: 0 in 0.491s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:13 devstack sudo[90135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.info
Apr 17 05:36:13 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:13 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:13 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:13 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Deleted volume successfully.
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-97ea0b98-2b97-4474-a206-0a23379560f1 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-cbba6802-a215-4d39-9712-aa747926d95b-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:14 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.info" returned: 0 in 0.439s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:14 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.info is being set with open permissions: ugo+rw
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:14 devstack sudo[90139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.info
Apr 17 05:36:14 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "cinder-f367d97b-aef4-4e11-86a5-fd8c09099ff8-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-f367d97b-aef4-4e11-86a5-fd8c09099ff8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "cinder-quobyte-f367d97b-aef4-4e11-86a5-fd8c09099ff8" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-quobyte-f367d97b-aef4-4e11-86a5-fd8c09099ff8" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb33627-23a0-4761-8fb9-0b459ce995e0]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:14 devstack sudo[90142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8
Apr 17 05:36:14 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:14 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.info" returned: 0 in 0.538s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.081s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.394s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Creating offline snapshot 15f1b4ad-4b00-4997-9e62-a481a30c6c35 of volume 8f2627c9-9add-471e-8e8d-4bf687572a1f {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b13615c-14e2-4a8c-861b-73da25ca1f0e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:14 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:14 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-82b65b1e-01f4-4bc1-b395-f2fb6918d857 tempest-VolumeDependencyTests-381097656 None] Create snapshot completed successfully
Apr 17 05:36:14 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f
Apr 17 05:36:14 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:15 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8" returned: 0 in 0.537s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:15 devstack sudo[90149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8
Apr 17 05:36:15 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:15 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f" returned: 0 in 0.530s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:15 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35 1G
Apr 17 05:36:15 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:15 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f367d97b-aef4-4e11-86a5-fd8c09099ff8" returned: 0 in 0.498s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-quobyte-f367d97b-aef4-4e11-86a5-fd8c09099ff8" released by "delete_volume" :: held 1.073s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Created reservations ['551d2dc4-5620-4202-8c2f-ff693c857532', '52be728f-b8b2-48fd-a422-7201ae7f65d7', 'a9204c63-51c1-4de0-a747-512f5c69963a', '291a3c66-e145-4bf3-bdee-278041a656fd'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:15 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:15 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Flow 'volume_create_manager' (11ea9132-731c-4b13-b37a-128c2210a3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fc28d6-6bdb-4314-a0db-4fc0f3875d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fc28d6-6bdb-4314-a0db-4fc0f3875d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1094890707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a63e9b0-4a5d-4310-b873-f51bab4be96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf04075510da461aa8c934a9d4490908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=517c41ae-7da8-4859-8581-995418af3e5f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:16Z,use_quota=True,user_id='18da1b80c28742cb819d2fb8ce78713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48c329e-a69d-4930-a9a0-cfbc48ed3ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48c329e-a69d-4930-a9a0-cfbc48ed3ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb388aff-81e0-4463-a099-b3e9707a7a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb388aff-81e0-4463-a099-b3e9707a7a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a63e9b0-4a5d-4310-b873-f51bab4be96f', 'volume_name': 'volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f', 'volume_size': 1, 'snapshot_id': '517c41ae-7da8-4859-8581-995418af3e5f'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfc22ea-4a1a-4c4a-bf29-a0e33879bc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfc22ea-4a1a-4c4a-bf29-a0e33879bc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:15 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a956b2-7b0f-4f43-a116-689b73695c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:15 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Volume 7a63e9b0-4a5d-4310-b873-f51bab4be96f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f', 'volume_size': 1, 'snapshot_id': '517c41ae-7da8-4859-8581-995418af3e5f'}
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:16 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35 1G" returned: 0 in 0.706s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2627c9-9add-471e-8e8d-4bf687572a1f -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:16 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2627c9-9add-471e-8e8d-4bf687572a1f -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35
Apr 17 05:36:16 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:16 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.511s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:16 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Deleted volume successfully.
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e3138a73-c167-4a89-9b07-e0b93081d8e0 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-f367d97b-aef4-4e11-86a5-fd8c09099ff8-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:16 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2627c9-9add-471e-8e8d-4bf687572a1f -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35" returned: 0 in 0.634s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:16 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35 is being set with open permissions: ugo+rw
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:16 devstack sudo[90168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35
Apr 17 05:36:16 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "cinder-73b324c4-72d4-46b2-9557-327be84464f2-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-73b324c4-72d4-46b2-9557-327be84464f2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "cinder-quobyte-73b324c4-72d4-46b2-9557-327be84464f2" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-quobyte-73b324c4-72d4-46b2-9557-327be84464f2" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fd50fc-183f-4319-a1c0-df5dcef965a5]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:16 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:17 devstack sudo[90170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2
Apr 17 05:36:17 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:17 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35" returned: 0 in 0.472s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:17 devstack sudo[90174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.info
Apr 17 05:36:17 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:17 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2" returned: 0 in 0.544s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:17 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2
Apr 17 05:36:17 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:17 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.info" returned: 0 in 0.439s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:17 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.info is being set with open permissions: ugo+rw
Apr 17 05:36:17 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:17 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.info
Apr 17 05:36:17 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:18 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-73b324c4-72d4-46b2-9557-327be84464f2" returned: 0 in 0.549s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-quobyte-73b324c4-72d4-46b2-9557-327be84464f2" released by "delete_volume" :: held 1.120s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Created reservations ['949917ee-e78a-4451-990c-e8e281d25886', '5f2a5968-3269-4fd4-a187-faffec97c368', 'd3c03b00-a1c7-4c35-89ca-61a681ff479d', 'd30b477a-7387-4679-9d11-c637c6d295b9'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:18 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.info" returned: 0 in 0.499s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.343s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.150s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:18 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-quobyte-517c41ae-7da8-4859-8581-995418af3e5f-7a63e9b0-4a5d-4310-b873-f51bab4be96f" by "_create_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:18 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-517c41ae-7da8-4859-8581-995418af3e5f-7a63e9b0-4a5d-4310-b873-f51bab4be96f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Creating volume 7a63e9b0-4a5d-4310-b873-f51bab4be96f from snapshot 517c41ae-7da8-4859-8581-995418af3e5f {{(pid=82266) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-quobyte-7a63e9b0-4a5d-4310-b873-f51bab4be96f" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:18 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-038e9170-717c-4574-bcad-8d6d50b23ace tempest-CreateVolumesFromSnapshotTest-625778028 None] Create snapshot completed successfully
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-7a63e9b0-4a5d-4310-b873-f51bab4be96f" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] snapshot: 517c41ae-7da8-4859-8581-995418af3e5f, volume: 7a63e9b0-4a5d-4310-b873-f51bab4be96f,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66d3be0-ff1d-4b43-960a-5a2de9df869f]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:18 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f
Apr 17 05:36:18 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:18 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.443s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:18 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Deleted volume successfully.
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9660273f-553f-419d-8673-bc08e8259b0d tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-73b324c4-72d4-46b2-9557-327be84464f2-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:18 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f" returned: 0 in 0.563s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7d784c-4230-4cf5-a685-ca94075ec206(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede1e7a-3035-4c8b-880d-c201b3fde9b1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:18 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:18 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206
Apr 17 05:36:18 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (4fada391-9653-4566-a0cb-bd6b9ef8d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166bec6d-df60-4f35-b581-9c4bdd5f1d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166bec6d-df60-4f35-b581-9c4bdd5f1d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-262227865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90596b79-2ec4-444d-bbdd-0e2633b4777b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:19Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b111c9-f502-4758-bbf8-bed5255655fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b111c9-f502-4758-bbf8-bed5255655fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfa97ef-b447-4845-a7d7-37fc5503e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfa97ef-b447-4845-a7d7-37fc5503e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90596b79-2ec4-444d-bbdd-0e2633b4777b', 'volume_name': 'volume-90596b79-2ec4-444d-bbdd-0e2633b4777b', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5370d76a-7e6e-4c78-95f0-d32277c8daa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5370d76a-7e6e-4c78-95f0-d32277c8daa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b19195-8424-4b79-b75a-ab65f41d2a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume 90596b79-2ec4-444d-bbdd-0e2633b4777b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90596b79-2ec4-444d-bbdd-0e2633b4777b', 'volume_size': 1}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "cinder-7194764f-5fe9-4cad-b814-500c9f5b2c36-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-7194764f-5fe9-4cad-b814-500c9f5b2c36-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "cinder-quobyte-7194764f-5fe9-4cad-b814-500c9f5b2c36" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-quobyte-7194764f-5fe9-4cad-b814-500c9f5b2c36" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b271c06-a0ef-4e69-9812-675358109f3a]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:19 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36
Apr 17 05:36:19 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (9e3b778b-f401-491b-92e2-d4b9f1d775de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caae637-fa13-44f2-b9f6-a9eb0c71d82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caae637-fa13-44f2-b9f6-a9eb0c71d82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-196673251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5219808-55ef-4901-8e48-8d5be3ce1556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:19Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1f3440-ca34-4260-a9f1-0abfc71dcf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1f3440-ca34-4260-a9f1-0abfc71dcf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7264edb-ff06-42ce-80cf-4c4ec97bdc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7264edb-ff06-42ce-80cf-4c4ec97bdc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5219808-55ef-4901-8e48-8d5be3ce1556', 'volume_name': 'volume-b5219808-55ef-4901-8e48-8d5be3ce1556', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409803f2-00a2-4d86-ae9a-3f73946b5fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409803f2-00a2-4d86-ae9a-3f73946b5fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f0e2d9-abb1-4bc5-9686-6a52d700812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume b5219808-55ef-4901-8e48-8d5be3ce1556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5219808-55ef-4901-8e48-8d5be3ce1556', 'volume_size': 1}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:19 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206" returned: 0 in 0.680s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:19 devstack sudo[90201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f
Apr 17 05:36:19 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (c74e9b42-f407-413e-b83d-00d0139c86e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5629d38-220c-4269-ba2a-af64a138cedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5629d38-220c-4269-ba2a-af64a138cedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726400575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:20Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142562cf-f355-4c69-93b6-904369001120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142562cf-f355-4c69-93b6-904369001120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a2357d-ccb7-4a56-8e30-ca82eaef9473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a2357d-ccb7-4a56-8e30-ca82eaef9473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9', 'volume_name': 'volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077dc71c-4c22-4be8-bf3b-3a9d32341e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077dc71c-4c22-4be8-bf3b-3a9d32341e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429504ff-b90b-4f18-bef5-df0d8fc1b0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume 1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9', 'volume_size': 1}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:19 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36" returned: 0 in 0.669s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:19 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36
Apr 17 05:36:19 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Flow 'volume_create_manager' (9757461b-6f6a-411b-9758-e3e4226c855c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af56984-8039-4ade-9997-6884b2c29989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:19 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (63ac1e1c-e63d-4242-a712-837b82dde20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeba995c-f440-4377-8c3c-bf6e07f2cd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af56984-8039-4ade-9997-6884b2c29989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1493015291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522c29cf-4edb-4818-a95d-fd015efbc406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e6d0f0baa047069b0f7e636381d3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:20Z,use_quota=True,user_id='262a8ab3881d40a4833febaf5085556d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac40ea6-a7bf-416d-8db2-ae0ae7836aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac40ea6-a7bf-416d-8db2-ae0ae7836aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2263949e-8d84-4c15-b084-4135e2358886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2263949e-8d84-4c15-b084-4135e2358886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522c29cf-4edb-4818-a95d-fd015efbc406', 'volume_name': 'volume-522c29cf-4edb-4818-a95d-fd015efbc406', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4464cce2-146c-4a00-bc62-1850c25d4cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4464cce2-146c-4a00-bc62-1850c25d4cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c28cb68-15e3-4f42-bd99-2368262fa11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Volume 522c29cf-4edb-4818-a95d-fd015efbc406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522c29cf-4edb-4818-a95d-fd015efbc406', 'volume_size': 1}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeba995c-f440-4377-8c3c-bf6e07f2cd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-717743865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f92f47-9286-4784-99df-69523d5e3d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:20Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f751db9d-5bd2-4fbd-90ca-c85539c875ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f751db9d-5bd2-4fbd-90ca-c85539c875ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3344a846-e61b-453d-8c29-f178a6577ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3344a846-e61b-453d-8c29-f178a6577ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f92f47-9286-4784-99df-69523d5e3d49', 'volume_name': 'volume-90f92f47-9286-4784-99df-69523d5e3d49', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95df9370-f4fa-4cee-aee5-214602630936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95df9370-f4fa-4cee-aee5-214602630936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6018bc7-cba6-453f-a623-009132660c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume 90f92f47-9286-4784-99df-69523d5e3d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f92f47-9286-4784-99df-69523d5e3d49', 'volume_size': 1}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (f5dd67e3-fcea-4507-83dc-c9c25c3f7318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd67dfb-5f88-40d3-9a3c-9757929f46d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd67dfb-5f88-40d3-9a3c-9757929f46d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1802968933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd0df06-b339-4139-9ce8-447672dcde67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:20Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c59652-fea1-4390-9a52-67949122a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c59652-fea1-4390-9a52-67949122a77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404ee28b-0444-47ec-89fb-36e896c478e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404ee28b-0444-47ec-89fb-36e896c478e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd0df06-b339-4139-9ce8-447672dcde67', 'volume_name': 'volume-efd0df06-b339-4139-9ce8-447672dcde67', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ea84e6-7111-4c7b-9f98-fcefd286891b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ea84e6-7111-4c7b-9f98-fcefd286891b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77e2c1b-504b-400c-b371-9dcdcee30d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:20 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume efd0df06-b339-4139-9ce8-447672dcde67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd0df06-b339-4139-9ce8-447672dcde67', 'volume_size': 1}
Apr 17 05:36:20 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:21 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7194764f-5fe9-4cad-b814-500c9f5b2c36" returned: 0 in 1.452s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-quobyte-7194764f-5fe9-4cad-b814-500c9f5b2c36" released by "delete_volume" :: held 2.178s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Created reservations ['6c1b99b6-b2bc-4fb5-97e0-4d24fca1781e', 'da2834d8-426b-40d0-a0b8-233eb8046a4b', 'efc45b62-2392-4412-a725-835d90e4aabb', 'f9894e1c-c12d-40da-b9e8-9cfc7f5c3471'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:21 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:21 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:21 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f" returned: 0 in 2.274s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0699d-2c66-45a0-8c1b-5a16336942b1]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:21 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:21 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206
Apr 17 05:36:21 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:22 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.457s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:22 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Deleted volume successfully.
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d2adaad4-c127-4c34-ad49-97edef979d97 tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-7194764f-5fe9-4cad-b814-500c9f5b2c36-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:22 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206" returned: 0 in 0.612s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:36:22 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Converted 1024.00 MB image at 450.11 MB/s
Apr 17 05:36:22 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f is being set with open permissions: ugo+rw
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:22 devstack sudo[90228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f
Apr 17 05:36:22 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "cinder-355fd99b-0240-46ce-9096-465d97859f40-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-355fd99b-0240-46ce-9096-465d97859f40-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "cinder-quobyte-355fd99b-0240-46ce-9096-465d97859f40" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-quobyte-355fd99b-0240-46ce-9096-465d97859f40" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f3b088-21a5-4620-ab45-16c7660e7ea0]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:22 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40
Apr 17 05:36:22 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:22 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f" returned: 0 in 0.430s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-7a63e9b0-4a5d-4310-b873-f51bab4be96f" released by "_copy_volume_from_snapshot" :: held 4.639s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-517c41ae-7da8-4859-8581-995418af3e5f-7a63e9b0-4a5d-4310-b873-f51bab4be96f" released by "_create_volume_from_snapshot" :: held 4.658s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.677s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.724s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-262227865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90596b79-2ec4-444d-bbdd-0e2633b4777b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:19Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Creating volume 90596b79-2ec4-444d-bbdd-0e2633b4777b {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:22 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:22 devstack sudo[90233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b 1073741824
Apr 17 05:36:22 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a956b2-7b0f-4f43-a116-689b73695c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f', 'volume_size': 1, 'snapshot_id': '517c41ae-7da8-4859-8581-995418af3e5f'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f330af11-8284-4462-bfae-143c26102b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:22 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Volume volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f (7a63e9b0-4a5d-4310-b873-f51bab4be96f): created successfully
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f330af11-8284-4462-bfae-143c26102b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:22 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Flow 'volume_create_manager' (11ea9132-731c-4b13-b37a-128c2210a3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:22 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-bc91efeb-1863-423f-9d2c-bc24373db39b tempest-VolumeDependencyTests-381097656 None] Created volume successfully.
Apr 17 05:36:23 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40" returned: 0 in 0.483s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:23 devstack sudo[90241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40
Apr 17 05:36:23 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:23 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b 1073741824" returned: 0 in 0.492s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:23 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b
Apr 17 05:36:23 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-517c41ae-7da8-4859-8581-995418af3e5f-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-517c41ae-7da8-4859-8581-995418af3e5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-quobyte-1a7d784c-4230-4cf5-a685-ca94075ec206" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-1a7d784c-4230-4cf5-a685-ca94075ec206" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-quobyte-517c41ae-7da8-4859-8581-995418af3e5f" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-517c41ae-7da8-4859-8581-995418af3e5f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Deleting offline snapshot 517c41ae-7da8-4859-8581-995418af3e5f of volume 1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] snapshot_file for this snap is: volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a79523-1d43-4644-a8a3-3297ee64bd36]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:23 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f
Apr 17 05:36:23 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:23 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-355fd99b-0240-46ce-9096-465d97859f40" returned: 0 in 0.474s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-quobyte-355fd99b-0240-46ce-9096-465d97859f40" released by "delete_volume" :: held 0.978s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Created reservations ['a409df66-2514-4f2d-9851-c9a1b63540c9', '16b3337e-c015-475b-b868-623f202b2fed', 'a08bb966-f251-4a4e-a68a-4b943be96100', '5a98554a-cb5b-4f7b-8b12-53bc3db5c5cf'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:23 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b" returned: 0 in 0.435s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:23 devstack sudo[90249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.341s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:23 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-196673251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5219808-55ef-4901-8e48-8d5be3ce1556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:19Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Creating volume b5219808-55ef-4901-8e48-8d5be3ce1556 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:23 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b19195-8424-4b79-b75a-ab65f41d2a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90596b79-2ec4-444d-bbdd-0e2633b4777b', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10247d4c-61a6-4fc5-886b-d57beaa1a0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:23 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556 1073741824
Apr 17 05:36:23 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:23 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume volume-90596b79-2ec4-444d-bbdd-0e2633b4777b (90596b79-2ec4-444d-bbdd-0e2633b4777b): created successfully
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10247d4c-61a6-4fc5-886b-d57beaa1a0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:23 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (4fada391-9653-4566-a0cb-bd6b9ef8d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:23 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-54f21284-cd1f-4efc-9d74-d4c89157e60f tempest-CreateVolumesFromSnapshotTest-625778028 None] Created volume successfully.
Apr 17 05:36:24 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f" returned: 0 in 0.494s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7d784c-4230-4cf5-a685-ca94075ec206(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce95a76-b295-4212-95f1-9a4cd9f684b5]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:24 devstack sudo[90256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206
Apr 17 05:36:24 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:24 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.451s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:24 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Deleted volume successfully.
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e6fb2385-d330-4f05-9a1e-56024de2192c tempest-CreateVolumesFromImageTest-2105451086 None] Lock "cinder-355fd99b-0240-46ce-9096-465d97859f40-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:24 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556 1073741824" returned: 0 in 0.537s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:24 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556
Apr 17 05:36:24 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:24 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206" returned: 0 in 0.542s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:24 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f
Apr 17 05:36:24 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:24 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.969s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726400575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:20Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Creating volume 1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:24 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f0e2d9-abb1-4bc5-9686-6a52d700812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5219808-55ef-4901-8e48-8d5be3ce1556', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73eff25a-f451-4f5b-9ba8-ae652c958e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:24 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9 1073741824
Apr 17 05:36:24 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:24 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume volume-b5219808-55ef-4901-8e48-8d5be3ce1556 (b5219808-55ef-4901-8e48-8d5be3ce1556): created successfully
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73eff25a-f451-4f5b-9ba8-ae652c958e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:24 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (9e3b778b-f401-491b-92e2-d4b9f1d775de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:24 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5f14d832-ef62-402f-b2f5-cfc5b46fa775 tempest-CreateVolumesFromSnapshotTest-625778028 None] Created volume successfully.
Apr 17 05:36:25 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f" returned: 0 in 0.469s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:25 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f
Apr 17 05:36:25 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:25 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9 1073741824" returned: 0 in 0.569s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:25 devstack sudo[90280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9
Apr 17 05:36:25 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:25 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206.517c41ae-7da8-4859-8581-995418af3e5f" returned: 0 in 0.466s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-517c41ae-7da8-4859-8581-995418af3e5f" released by "_delete_snapshot" :: held 2.032s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-1a7d784c-4230-4cf5-a685-ca94075ec206" released by "delete_snapshot" :: held 2.047s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Created reservations ['84686ef0-4a12-466a-af1a-89b62ca9de93', '62a41752-3a77-4140-95b8-a81fa68a029b', '1bc9041e-e31a-477c-8a35-dd3f20ec88cc', '1652070c-d626-40df-9768-796e5ea63d9b'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:25 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Delete snapshot completed successfully.
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-18f82941-b21e-4f4c-bf2c-94b94f245fe9 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-517c41ae-7da8-4859-8581-995418af3e5f-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:25 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9" returned: 0 in 0.492s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.594s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1493015291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522c29cf-4edb-4818-a95d-fd015efbc406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e6d0f0baa047069b0f7e636381d3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:20Z,use_quota=True,user_id='262a8ab3881d40a4833febaf5085556d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Creating volume 522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:25 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429504ff-b90b-4f18-bef5-df0d8fc1b0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:25 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 1073741824
Apr 17 05:36:25 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610f0325-3c70-4079-8e33-61f3d119ff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:25 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9 (1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9): created successfully
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610f0325-3c70-4079-8e33-61f3d119ff22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:25 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (c74e9b42-f407-413e-b83d-00d0139c86e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:25 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-50de8813-6a43-429d-9bbf-ada9d094e178 tempest-CreateVolumesFromSnapshotTest-625778028 None] Created volume successfully.
Apr 17 05:36:26 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 1073741824" returned: 0 in 0.576s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:26 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406
Apr 17 05:36:26 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (fb31a928-54cc-4671-8930-d52b585b89c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26de880f-3f41-4d88-a21d-3d9ce2affae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26de880f-3f41-4d88-a21d-3d9ce2affae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1344228167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc57244-4a4c-47c9-a6a7-ed317b1a1b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:27Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6d5fde-c0cc-42ce-9a12-88909888cfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6d5fde-c0cc-42ce-9a12-88909888cfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a4624d-ffc9-4038-8143-162a120d02f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a4624d-ffc9-4038-8143-162a120d02f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc57244-4a4c-47c9-a6a7-ed317b1a1b10', 'volume_name': 'volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdf5d14-cf2c-4566-b4e2-f10a6d397ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdf5d14-cf2c-4566-b4e2-f10a6d397ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9463d947-beae-4b6d-95bd-653223c73489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:26 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume 6cc57244-4a4c-47c9-a6a7-ed317b1a1b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10', 'volume_size': 1}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-1a7d784c-4230-4cf5-a685-ca94075ec206-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-1a7d784c-4230-4cf5-a685-ca94075ec206-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-quobyte-1a7d784c-4230-4cf5-a685-ca94075ec206" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-1a7d784c-4230-4cf5-a685-ca94075ec206" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5ca678-5f93-4141-9813-f1c995b0c3f5]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:26 devstack sudo[90293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206
Apr 17 05:36:26 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:26 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406" returned: 0 in 0.477s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.488s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-717743865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f92f47-9286-4784-99df-69523d5e3d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:20Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Creating volume 90f92f47-9286-4784-99df-69523d5e3d49 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:26 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c28cb68-15e3-4f42-bd99-2368262fa11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522c29cf-4edb-4818-a95d-fd015efbc406', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:26 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49 1073741824
Apr 17 05:36:26 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:26 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8be64f-f0be-48da-9e7b-81ae75100ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:27 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Volume volume-522c29cf-4edb-4818-a95d-fd015efbc406 (522c29cf-4edb-4818-a95d-fd015efbc406): created successfully
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8be64f-f0be-48da-9e7b-81ae75100ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Flow 'volume_create_manager' (9757461b-6f6a-411b-9758-e3e4226c855c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:27 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-166c5162-5beb-48da-b0e8-a081a137e50d tempest-SnapshotDependencyTests-413055425 None] Created volume successfully.
Apr 17 05:36:27 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206" returned: 0 in 0.491s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:27 devstack sudo[90302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206
Apr 17 05:36:27 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:27 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49 1073741824" returned: 0 in 0.480s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:27 devstack sudo[90307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49
Apr 17 05:36:27 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:27 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1a7d784c-4230-4cf5-a685-ca94075ec206" returned: 0 in 0.457s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-1a7d784c-4230-4cf5-a685-ca94075ec206" released by "delete_volume" :: held 0.976s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Created reservations ['2251bc48-f686-43cb-832b-d7ea85dbfa06', 'cd5bd4a1-47fd-43d1-a2d8-1efd6bb306d2', 'cec30ad9-788b-48c1-bee3-17b21768882f', '21bea60d-c089-4ba0-b0ed-362e84064a08'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:27 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:27 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:27 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49" returned: 0 in 0.441s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.291s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1802968933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd0df06-b339-4139-9ce8-447672dcde67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71ef9c5d854c3fa505f010254ea4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:20Z,use_quota=True,user_id='acad60aca7f240f49cc38c3df0134aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Creating volume efd0df06-b339-4139-9ce8-447672dcde67 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:27 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6018bc7-cba6-453f-a623-009132660c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f92f47-9286-4784-99df-69523d5e3d49', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:27 devstack sudo[90313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67 1073741824
Apr 17 05:36:27 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ebf78d-bbea-42d0-8806-fa26115983d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:27 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume volume-90f92f47-9286-4784-99df-69523d5e3d49 (90f92f47-9286-4784-99df-69523d5e3d49): created successfully
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ebf78d-bbea-42d0-8806-fa26115983d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:27 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (63ac1e1c-e63d-4242-a712-837b82dde20a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:27 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-f2c0414d-9b60-40ab-80e2-d8cc80eb2914 tempest-CreateVolumesFromSnapshotTest-625778028 None] Created volume successfully.
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Flow 'volume_create_manager' (df33441f-44b0-4ae0-8353-c2091d1a8af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c803949e-2661-47de-882d-e840e310c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c803949e-2661-47de-882d-e840e310c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1861824641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79a6fb6-7b5b-4d82-bce3-0b8537334153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf04075510da461aa8c934a9d4490908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:28Z,use_quota=True,user_id='18da1b80c28742cb819d2fb8ce78713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d6d8bc-a6e0-47c4-ab72-3af9a07c8289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d6d8bc-a6e0-47c4-ab72-3af9a07c8289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936c45a0-699b-42f0-9edc-deed834baec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936c45a0-699b-42f0-9edc-deed834baec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79a6fb6-7b5b-4d82-bce3-0b8537334153', 'volume_name': 'volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a01d727-dc18-4558-ba12-6bfaa11623ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a01d727-dc18-4558-ba12-6bfaa11623ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee5a04b-3945-4bba-a351-059ecb94c34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:28 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Volume a79a6fb6-7b5b-4d82-bce3-0b8537334153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153', 'volume_size': 1}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:28 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.474s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:28 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Deleted volume successfully.
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d0a3cffd-4f43-4eef-a492-b1b510127d79 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-1a7d784c-4230-4cf5-a685-ca94075ec206-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:28 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67 1073741824" returned: 0 in 0.519s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:28 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67
Apr 17 05:36:28 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:28 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67" returned: 0 in 0.399s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.267s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1344228167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc57244-4a4c-47c9-a6a7-ed317b1a1b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:27Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Creating volume 6cc57244-4a4c-47c9-a6a7-ed317b1a1b10 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:28 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77e2c1b-504b-400c-b371-9dcdcee30d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd0df06-b339-4139-9ce8-447672dcde67', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:28 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10 1073741824
Apr 17 05:36:28 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dd51b1-75d0-4464-8eff-763a8ddebce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:28 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Volume volume-efd0df06-b339-4139-9ce8-447672dcde67 (efd0df06-b339-4139-9ce8-447672dcde67): created successfully
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dd51b1-75d0-4464-8eff-763a8ddebce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:28 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Flow 'volume_create_manager' (f5dd67e3-fcea-4507-83dc-c9c25c3f7318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:28 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-807dd005-728e-400c-9b6d-4fb465241f44 tempest-CreateVolumesFromSnapshotTest-625778028 None] Created volume successfully.
Apr 17 05:36:29 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10 1073741824" returned: 0 in 0.480s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:29 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10
Apr 17 05:36:29 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:29 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10" returned: 0 in 0.398s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.186s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Creating offline snapshot 1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 of volume 522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9463d947-beae-4b6d-95bd-653223c73489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19576c07-0faa-489e-8c3f-825983cdd420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6470b727-60f5-49de-bcc3-902bd6e97a77]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:29 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10 (6cc57244-4a4c-47c9-a6a7-ed317b1a1b10): created successfully
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19576c07-0faa-489e-8c3f-825983cdd420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:29 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (fb31a928-54cc-4671-8930-d52b585b89c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:29 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ec227691-e51b-41a7-9445-484409969fee tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created volume successfully.
Apr 17 05:36:29 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406
Apr 17 05:36:29 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-efd0df06-b339-4139-9ce8-447672dcde67-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-efd0df06-b339-4139-9ce8-447672dcde67-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-quobyte-efd0df06-b339-4139-9ce8-447672dcde67" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-efd0df06-b339-4139-9ce8-447672dcde67" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[054fdf96-5615-4e2b-b309-e76e63361186]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:30 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67
Apr 17 05:36:30 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:30 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406" returned: 0 in 0.460s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:30 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 1G
Apr 17 05:36:30 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:30 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67" returned: 0 in 0.485s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:30 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67
Apr 17 05:36:30 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:30 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 1G" returned: 0 in 0.477s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:30 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522c29cf-4edb-4818-a95d-fd015efbc406 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:30 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522c29cf-4edb-4818-a95d-fd015efbc406 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9
Apr 17 05:36:30 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (c507fbe5-a16a-43d9-a8f6-1e1cbdafc6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66005cb5-6275-4ca5-b97e-6fe1de222342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66005cb5-6275-4ca5-b97e-6fe1de222342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1194330668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938c7cb3-ff5b-4242-9757-debd00b98a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:31Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111b22e4-a84d-4626-bcf4-e85d1da15544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111b22e4-a84d-4626-bcf4-e85d1da15544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbc406c-8e64-403f-b1dd-761ad41a94b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbc406c-8e64-403f-b1dd-761ad41a94b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938c7cb3-ff5b-4242-9757-debd00b98a3d', 'volume_name': 'volume-938c7cb3-ff5b-4242-9757-debd00b98a3d', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44208b42-6e06-49e7-b29a-3d5b05ed37a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44208b42-6e06-49e7-b29a-3d5b05ed37a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0146bb84-1d4c-465e-8e6b-09d7a8649e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume 938c7cb3-ff5b-4242-9757-debd00b98a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938c7cb3-ff5b-4242-9757-debd00b98a3d', 'volume_size': 1}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-efd0df06-b339-4139-9ce8-447672dcde67" returned: 0 in 0.528s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-efd0df06-b339-4139-9ce8-447672dcde67" released by "delete_volume" :: held 1.052s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Created reservations ['b59eceec-0312-4612-8e35-329957f4b256', '5e3fd85f-23a7-4ba5-b545-ca6bd1bcce32', '8b1ecf73-d669-4378-a9ff-1c0df7ee07e8', 'd29a501f-af29-4af6-b12f-11013fa94fe6'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:31 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:31 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:31 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522c29cf-4edb-4818-a95d-fd015efbc406 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9" returned: 0 in 0.480s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:31 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 is being set with open permissions: ugo+rw
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:31 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9
Apr 17 05:36:31 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (60ea85f5-be01-4e7d-a151-8f20564af988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43bc1d4-cc77-447f-869e-9cd2b6a16a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43bc1d4-cc77-447f-869e-9cd2b6a16a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925448726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11609b3a-5235-4af7-b318-178ad87c4624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:31Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc24bc8-036f-4aec-ab7a-cca706a1df04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc24bc8-036f-4aec-ab7a-cca706a1df04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f914558f-a9a1-4546-aabd-dfb8990a4227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f914558f-a9a1-4546-aabd-dfb8990a4227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11609b3a-5235-4af7-b318-178ad87c4624', 'volume_name': 'volume-11609b3a-5235-4af7-b318-178ad87c4624', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5319e52d-bfdf-4754-856b-4b129bb40000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5319e52d-bfdf-4754-856b-4b129bb40000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ced4ef-efe9-4deb-bec3-64fcd78da18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume 11609b3a-5235-4af7-b318-178ad87c4624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11609b3a-5235-4af7-b318-178ad87c4624', 'volume_size': 1}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (04c2a44a-8ca9-4001-859f-9f71b4e01e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0165ff-7910-4629-99b6-d6f8e729bf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0165ff-7910-4629-99b6-d6f8e729bf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-346871781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02040eef-60da-4e4d-91b3-792cae26adae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:31Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c1b503-7c2f-47f2-a27a-b92fb41b7fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c1b503-7c2f-47f2-a27a-b92fb41b7fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd70908-2b57-4e45-8453-5807019b48dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd70908-2b57-4e45-8453-5807019b48dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02040eef-60da-4e4d-91b3-792cae26adae', 'volume_name': 'volume-02040eef-60da-4e4d-91b3-792cae26adae', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9f1dcd-250d-46ab-a7e1-71b5786d52e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9f1dcd-250d-46ab-a7e1-71b5786d52e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3234fa-c82a-4910-847b-3d255e76a386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume 02040eef-60da-4e4d-91b3-792cae26adae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02040eef-60da-4e4d-91b3-792cae26adae', 'volume_size': 1}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (6ed59168-a80f-473f-b115-f7e7fd751ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a410df-f60d-4388-8fb7-9444d2c53396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a410df-f60d-4388-8fb7-9444d2c53396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75730122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bf47cb-d0c5-476b-9269-8d685d33a614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:32Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a3d54c-be4f-49ef-99f1-abb179a0baa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a3d54c-be4f-49ef-99f1-abb179a0baa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71519523-a1c9-4fa0-a0ff-ae75525dc347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71519523-a1c9-4fa0-a0ff-ae75525dc347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93bf47cb-d0c5-476b-9269-8d685d33a614', 'volume_name': 'volume-93bf47cb-d0c5-476b-9269-8d685d33a614', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d248c4-899b-4a6b-b98e-6c40aae832c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d248c4-899b-4a6b-b98e-6c40aae832c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abdbc75-b26b-4cc8-923d-8634f04c530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume 93bf47cb-d0c5-476b-9269-8d685d33a614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93bf47cb-d0c5-476b-9269-8d685d33a614', 'volume_size': 1}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:31 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9" returned: 0 in 0.463s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:31 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.info
Apr 17 05:36:31 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:31 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.592s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:31 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Deleted volume successfully.
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (15980a8f-2469-44ee-8b43-f82ccba24ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7299f5-5d1c-441b-ae1d-5eda4203c921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-422a02d5-42e1-417d-8421-aa84b6337563 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-efd0df06-b339-4139-9ce8-447672dcde67-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7299f5-5d1c-441b-ae1d-5eda4203c921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383702679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff580177-d9ed-4fc4-a248-afddb19125af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:32Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78944b24-5859-4166-abef-312cc55a7afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78944b24-5859-4166-abef-312cc55a7afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92b5695-a98e-40c4-ab1c-fa409aefb63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92b5695-a98e-40c4-ab1c-fa409aefb63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff580177-d9ed-4fc4-a248-afddb19125af', 'volume_name': 'volume-ff580177-d9ed-4fc4-a248-afddb19125af', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d46137f-36c6-4e4a-9648-a1fea400d767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d46137f-36c6-4e4a-9648-a1fea400d767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1dfade0-3fd1-44f1-b4dd-8e2605a07c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:31 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume ff580177-d9ed-4fc4-a248-afddb19125af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff580177-d9ed-4fc4-a248-afddb19125af', 'volume_size': 1}
Apr 17 05:36:31 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:32 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.info" returned: 0 in 0.413s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:32 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.info is being set with open permissions: ugo+rw
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:32 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.info
Apr 17 05:36:32 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-90f92f47-9286-4784-99df-69523d5e3d49-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-90f92f47-9286-4784-99df-69523d5e3d49-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-quobyte-90f92f47-9286-4784-99df-69523d5e3d49" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-90f92f47-9286-4784-99df-69523d5e3d49" acquired by "delete_volume" :: waited 0.008s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c848d40-1179-4897-a654-ea4aa715f4fe]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:32 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49
Apr 17 05:36:32 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:32 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.info" returned: 0 in 0.409s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.494s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1861824641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79a6fb6-7b5b-4d82-bce3-0b8537334153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf04075510da461aa8c934a9d4490908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:28Z,use_quota=True,user_id='18da1b80c28742cb819d2fb8ce78713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Creating volume a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:32 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:32 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-af379c5c-2042-4b28-94bd-e77a24f54f07 tempest-SnapshotDependencyTests-413055425 None] Create snapshot completed successfully
Apr 17 05:36:32 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 1073741824
Apr 17 05:36:32 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:32 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49" returned: 0 in 0.495s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:32 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:32 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49
Apr 17 05:36:32 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:33 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 1073741824" returned: 0 in 0.507s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Flow 'volume_create_manager' (85e86e3d-0a52-4ae4-982e-94d25f598d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6388182c-372c-4d9b-a602-bd47f35f8cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6388182c-372c-4d9b-a602-bd47f35f8cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2a68a6-b810-47e7-9bd5-de95fc6804d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e6d0f0baa047069b0f7e636381d3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:33Z,use_quota=True,user_id='262a8ab3881d40a4833febaf5085556d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad44b573-85f8-44d5-8def-f499becc1dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad44b573-85f8-44d5-8def-f499becc1dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a74235-544b-4c17-bdd0-3fd5f237a392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a74235-544b-4c17-bdd0-3fd5f237a392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b2a68a6-b810-47e7-9bd5-de95fc6804d0', 'volume_name': 'volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0', 'volume_size': 1, 'snapshot_id': '1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8d2d9a-1107-4605-9f0b-c6967283bc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8d2d9a-1107-4605-9f0b-c6967283bc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2996d9bf-a536-4f1e-be0d-b9afec4f063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:33 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Volume 2b2a68a6-b810-47e7-9bd5-de95fc6804d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0', 'volume_size': 1, 'snapshot_id': '1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9'}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:33 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153
Apr 17 05:36:33 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:33 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90f92f47-9286-4784-99df-69523d5e3d49" returned: 0 in 0.494s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-90f92f47-9286-4784-99df-69523d5e3d49" released by "delete_volume" :: held 1.033s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Created reservations ['4286a13e-a163-4c9c-be20-11f389757d36', '285d2303-42cf-4d61-ad68-fe674e747163', '481435be-d53c-481c-be21-63922ea7c720', '65d46a46-db30-4dd2-b1c8-bdeecdceaea0'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:33 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:33 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:33 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153" returned: 0 in 0.429s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.527s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1194330668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938c7cb3-ff5b-4242-9757-debd00b98a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:31Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Creating volume 938c7cb3-ff5b-4242-9757-debd00b98a3d {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:33 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee5a04b-3945-4bba-a351-059ecb94c34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:33 devstack sudo[90383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d 1073741824
Apr 17 05:36:33 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd19b455-9d4b-43e1-b852-8f0288a59add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:33 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Volume volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 (a79a6fb6-7b5b-4d82-bce3-0b8537334153): created successfully
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd19b455-9d4b-43e1-b852-8f0288a59add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Flow 'volume_create_manager' (df33441f-44b0-4ae0-8353-c2091d1a8af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-b496a93c-71f4-4757-af27-a8160d5e0c0a tempest-VolumeDependencyTests-381097656 None] Created volume successfully.
Apr 17 05:36:33 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.426s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:33 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Deleted volume successfully.
Apr 17 05:36:33 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fcc382ae-d3ef-47e1-9e6b-c0a855a65452 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-90f92f47-9286-4784-99df-69523d5e3d49-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:34 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d 1073741824" returned: 0 in 0.500s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:34 devstack sudo[90389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d
Apr 17 05:36:34 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-quobyte-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b56968-6872-44fb-b969-3bcf80412284]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:34 devstack sudo[90392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9
Apr 17 05:36:34 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:34 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d" returned: 0 in 0.454s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.262s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925448726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11609b3a-5235-4af7-b318-178ad87c4624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:31Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Creating volume 11609b3a-5235-4af7-b318-178ad87c4624 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:34 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0146bb84-1d4c-465e-8e6b-09d7a8649e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938c7cb3-ff5b-4242-9757-debd00b98a3d', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2316dd-a694-4c20-8a96-23b9106a0a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:34 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume volume-938c7cb3-ff5b-4242-9757-debd00b98a3d (938c7cb3-ff5b-4242-9757-debd00b98a3d): created successfully
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2316dd-a694-4c20-8a96-23b9106a0a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (c507fbe5-a16a-43d9-a8f6-1e1cbdafc6b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:34 devstack sudo[90394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624 1073741824
Apr 17 05:36:34 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-57944a1e-9818-44c3-86bd-14bbaec62670 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created volume successfully.
Apr 17 05:36:34 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Flow 'volume_create_manager' (fd0c5679-c973-46a1-ae15-69f20981a5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b92d3c-a72c-4348-b6aa-e43cb4ef5159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b92d3c-a72c-4348-b6aa-e43cb4ef5159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-70423777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f407f04-1caa-437f-8316-46143c9506bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf04075510da461aa8c934a9d4490908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a79a6fb6-7b5b-4d82-bce3-0b8537334153,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:35Z,use_quota=True,user_id='18da1b80c28742cb819d2fb8ce78713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5798597-7ed1-401a-97a1-dc1d5c5a223f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5798597-7ed1-401a-97a1-dc1d5c5a223f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6400447-1d0e-4a4a-b027-f9cc88feff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6400447-1d0e-4a4a-b027-f9cc88feff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3f407f04-1caa-437f-8316-46143c9506bd', 'volume_name': 'volume-3f407f04-1caa-437f-8316-46143c9506bd', 'volume_size': 1, 'source_volid': 'a79a6fb6-7b5b-4d82-bce3-0b8537334153', 'source_volstatus': 'available'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26322f81-c878-48b9-a4e1-19c71abbb35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26322f81-c878-48b9-a4e1-19c71abbb35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac98c1e-4c13-4421-a782-cc14d32dc24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:34 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Volume 3f407f04-1caa-437f-8316-46143c9506bd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3f407f04-1caa-437f-8316-46143c9506bd', 'volume_size': 1, 'source_volid': 'a79a6fb6-7b5b-4d82-bce3-0b8537334153', 'source_volstatus': 'available'}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:34 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9" returned: 0 in 0.484s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:34 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:35 devstack sudo[90399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9
Apr 17 05:36:35 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:35 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624 1073741824" returned: 0 in 0.539s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:35 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624
Apr 17 05:36:35 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:35 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9" returned: 0 in 0.428s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9" released by "delete_volume" :: held 0.935s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Created reservations ['ab1bb913-95b1-49c8-8c6c-b2625740ee4f', '15f9c16d-5ece-40cb-891d-4fd58f198045', '233a51d5-e31b-4995-86ca-b42321e114e9', 'd80bff12-bb34-4024-8c3c-57eb1d976f14'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:35 devstack sudo[90408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:35 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-b5219808-55ef-4901-8e48-8d5be3ce1556-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-b5219808-55ef-4901-8e48-8d5be3ce1556-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:35 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624" returned: 0 in 0.421s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.164s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-346871781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02040eef-60da-4e4d-91b3-792cae26adae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:31Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Creating volume 02040eef-60da-4e4d-91b3-792cae26adae {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:35 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:35 devstack sudo[90410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae 1073741824
Apr 17 05:36:35 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-quobyte-b5219808-55ef-4901-8e48-8d5be3ce1556" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ced4ef-efe9-4deb-bec3-64fcd78da18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11609b3a-5235-4af7-b318-178ad87c4624', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecb7f47-9623-4f00-8ca0-95814bcc7bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:35 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume volume-11609b3a-5235-4af7-b318-178ad87c4624 (11609b3a-5235-4af7-b318-178ad87c4624): created successfully
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecb7f47-9623-4f00-8ca0-95814bcc7bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (60ea85f5-be01-4e7d-a151-8f20564af988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-b5219808-55ef-4901-8e48-8d5be3ce1556" acquired by "delete_volume" :: waited 0.036s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:35 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-cc890031-cc43-4740-a4f3-4fceea571607 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created volume successfully.
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d99723-67b8-4821-8841-486f6ca44249]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:35 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556
Apr 17 05:36:35 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:35 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.437s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:35 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Deleted volume successfully.
Apr 17 05:36:35 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-528e0ae9-8f22-485a-ad8a-9dc8517001d4 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-1f2ce6cb-bc06-4e25-a5cc-f7a2b2e734e9-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:36 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae 1073741824" returned: 0 in 0.511s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:36 devstack sudo[90421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae
Apr 17 05:36:36 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:36 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556" returned: 0 in 0.502s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:36 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556
Apr 17 05:36:36 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:36 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae" returned: 0 in 0.431s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.951s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75730122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bf47cb-d0c5-476b-9269-8d685d33a614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:32Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Creating volume 93bf47cb-d0c5-476b-9269-8d685d33a614 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:36 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3234fa-c82a-4910-847b-3d255e76a386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02040eef-60da-4e4d-91b3-792cae26adae', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a81efbc-40c8-4cf7-82b6-d7339458968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:36 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614 1073741824
Apr 17 05:36:36 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:36 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-b5219808-55ef-4901-8e48-8d5be3ce1556" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:36 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume volume-02040eef-60da-4e4d-91b3-792cae26adae (02040eef-60da-4e4d-91b3-792cae26adae): created successfully
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a81efbc-40c8-4cf7-82b6-d7339458968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (04c2a44a-8ca9-4001-859f-9f71b4e01e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:36 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-c1a0c9ba-ae55-49dd-abec-7a8500cfd9f8 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created volume successfully.
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-b5219808-55ef-4901-8e48-8d5be3ce1556" released by "delete_volume" :: held 0.979s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Created reservations ['d0337116-89b2-4ba2-9629-464e313b7007', '28d56915-f1a8-4b30-9aa8-0936df42b516', 'f9250a68-365a-41b9-917e-d4fcfbff3117', 'ee685939-c5e0-4c44-a439-d2b37d3ee755'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:36 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:36 devstack sudo[90429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:36 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:37 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614 1073741824" returned: 0 in 0.502s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:37 devstack sudo[90436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614
Apr 17 05:36:37 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:37 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.467s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:37 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Deleted volume successfully.
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-7597fe17-038a-45aa-8668-037162a92f3c tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-b5219808-55ef-4901-8e48-8d5be3ce1556-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:37 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614" returned: 0 in 0.412s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.679s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383702679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff580177-d9ed-4fc4-a248-afddb19125af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9edb0eefbf4d9aa2decea12037a1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:32Z,use_quota=True,user_id='0bbb7e04df214c3db233d82043943c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Creating volume ff580177-d9ed-4fc4-a248-afddb19125af {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:37 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:37 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af 1073741824
Apr 17 05:36:37 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abdbc75-b26b-4cc8-923d-8634f04c530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93bf47cb-d0c5-476b-9269-8d685d33a614', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb0094d-d9e1-47df-95e1-42ea09a8d542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:37 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume volume-93bf47cb-d0c5-476b-9269-8d685d33a614 (93bf47cb-d0c5-476b-9269-8d685d33a614): created successfully
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb0094d-d9e1-47df-95e1-42ea09a8d542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (6ed59168-a80f-473f-b115-f7e7fd751ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:37 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-32f148e0-cfe2-4411-a251-b86867d6d3f9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created volume successfully.
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-90596b79-2ec4-444d-bbdd-0e2633b4777b-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-90596b79-2ec4-444d-bbdd-0e2633b4777b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-quobyte-90596b79-2ec4-444d-bbdd-0e2633b4777b" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-90596b79-2ec4-444d-bbdd-0e2633b4777b" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ffc6f7-83d7-44f4-8e8d-688eb6afecff]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:37 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:37 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b
Apr 17 05:36:37 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:38 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af 1073741824" returned: 0 in 0.501s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:38 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af
Apr 17 05:36:38 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:38 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b" returned: 0 in 0.484s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:38 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b
Apr 17 05:36:38 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:38 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af" returned: 0 in 0.431s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.310s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "cinder-quobyte-1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" by "_create_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1dfade0-3fd1-44f1-b4dd-8e2605a07c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff580177-d9ed-4fc4-a248-afddb19125af', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc6c789-3bc8-476c-803c-cfcc04a6845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Creating volume 2b2a68a6-b810-47e7-9bd5-de95fc6804d0 from snapshot 1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 {{(pid=82266) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "cinder-quobyte-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:38 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Volume volume-ff580177-d9ed-4fc4-a248-afddb19125af (ff580177-d9ed-4fc4-a248-afddb19125af): created successfully
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc6c789-3bc8-476c-803c-cfcc04a6845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Flow 'volume_create_manager' (15980a8f-2469-44ee-8b43-f82ccba24ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] snapshot: 1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9, volume: 2b2a68a6-b810-47e7-9bd5-de95fc6804d0,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:36:38 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1e3096f5-9b1a-40b2-97aa-2ee0860e5200 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created volume successfully.
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7afa407-189b-4399-9026-b48e7f7b5161]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:38 devstack sudo[90454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9
Apr 17 05:36:38 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:38 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-90596b79-2ec4-444d-bbdd-0e2633b4777b" returned: 0 in 0.436s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-90596b79-2ec4-444d-bbdd-0e2633b4777b" released by "delete_volume" :: held 0.942s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Created reservations ['eb9ab88e-ae7c-40e4-a5d7-d337701da5c7', 'bbcf7244-5482-4a38-a550-e57230852151', 'a8aab652-8a6c-4f17-95a5-cff80bdd97ca', '3a41e6fe-f43c-448b-a8bc-5bcfda272057'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:38 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:38 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-15f1b4ad-4b00-4997-9e62-a481a30c6c35-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-15f1b4ad-4b00-4997-9e62-a481a30c6c35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-quobyte-8f2627c9-9add-471e-8e8d-4bf687572a1f" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-8f2627c9-9add-471e-8e8d-4bf687572a1f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-quobyte-15f1b4ad-4b00-4997-9e62-a481a30c6c35" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-15f1b4ad-4b00-4997-9e62-a481a30c6c35" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Deleting offline snapshot 15f1b4ad-4b00-4997-9e62-a481a30c6c35 of volume 8f2627c9-9add-471e-8e8d-4bf687572a1f {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] snapshot_file for this snap is: volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8ad7fb-4aff-4943-af51-58d06a0738ee]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:38 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:39 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35
Apr 17 05:36:39 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:39 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9" returned: 0 in 0.490s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-522c29cf-4edb-4818-a95d-fd015efbc406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6155cee4-b090-4572-b1e0-2166b308ece7]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:39 devstack sudo[90464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406
Apr 17 05:36:39 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:39 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.460s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:39 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Deleted volume successfully.
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-038751f8-d62e-4004-9767-62f6c405126f tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-90596b79-2ec4-444d-bbdd-0e2633b4777b-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-ff580177-d9ed-4fc4-a248-afddb19125af-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-ff580177-d9ed-4fc4-a248-afddb19125af-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-quobyte-ff580177-d9ed-4fc4-a248-afddb19125af" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-ff580177-d9ed-4fc4-a248-afddb19125af" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b5948c-f7a3-4e32-99e3-8e8f7976d447]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:39 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35" returned: 0 in 0.509s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f2627c9-9add-471e-8e8d-4bf687572a1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9d52c6-7676-43c8-a605-a2f5ae64eae0]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:39 devstack sudo[90470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af
Apr 17 05:36:39 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:39 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f
Apr 17 05:36:39 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:39 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406" returned: 0 in 0.507s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0 not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:39 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0
Apr 17 05:36:39 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:39 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af" returned: 0 in 0.493s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:39 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af
Apr 17 05:36:39 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:39 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f" returned: 0 in 0.490s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:39 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:39 devstack sudo[90489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35
Apr 17 05:36:39 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:40 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-ff580177-d9ed-4fc4-a248-afddb19125af" returned: 0 in 0.896s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:40 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-ff580177-d9ed-4fc4-a248-afddb19125af" released by "delete_volume" :: held 1.420s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:40 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35" returned: 0 in 0.905s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:40 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:40 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35
Apr 17 05:36:40 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:40 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created reservations ['4f6f857e-1f27-4277-9811-6ab133b4f396', 'fe69233b-bd66-4c20-9244-3c5e6fdb42c5', 'a0e38639-8c44-4b1a-b177-b4d81796afdd', '23907096-7428-465f-8b33-58496f7ea384'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:41 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:41 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-93bf47cb-d0c5-476b-9269-8d685d33a614-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-93bf47cb-d0c5-476b-9269-8d685d33a614-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-quobyte-93bf47cb-d0c5-476b-9269-8d685d33a614" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-93bf47cb-d0c5-476b-9269-8d685d33a614" acquired by "delete_volume" :: waited 0.015s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5328d9d5-0020-44b7-a54c-6b56ae004274]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:41 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f.15f1b4ad-4b00-4997-9e62-a481a30c6c35" returned: 0 in 1.009s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:41 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" returned: 0 in 2.285s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a330cd1b-ea75-4d3c-8cb5-84e9ad08d8d4]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-15f1b4ad-4b00-4997-9e62-a481a30c6c35" released by "_delete_snapshot" :: held 2.985s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-8f2627c9-9add-471e-8e8d-4bf687572a1f" released by "delete_snapshot" :: held 2.999s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:41 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614
Apr 17 05:36:41 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Created reservations ['817ffc75-dae9-41c9-9c6a-06f6e3c5670d', 'db398ae4-d7ee-4981-ba5e-ace269396755', 'e33bb225-5d45-4e00-9302-a010553b9a96', '0dcff868-aa16-4977-a05e-ac326ab161da'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:41 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406
Apr 17 05:36:41 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:41 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Delete snapshot completed successfully.
Apr 17 05:36:41 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-5458c9fa-4e85-426a-95b5-8009da92d05a tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-15f1b4ad-4b00-4997-9e62-a481a30c6c35-delete_snapshot" released by "delete_snapshot" :: held 3.089s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:42 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.829s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:42 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Deleted volume successfully.
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-e98d5491-933c-4062-a270-6e655ff13354 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-ff580177-d9ed-4fc4-a248-afddb19125af-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-8f2627c9-9add-471e-8e8d-4bf687572a1f-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-8f2627c9-9add-471e-8e8d-4bf687572a1f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "cinder-quobyte-8f2627c9-9add-471e-8e8d-4bf687572a1f" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-8f2627c9-9add-471e-8e8d-4bf687572a1f" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d52ca4-0943-4e3b-817a-e4bfd4317aaa]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:42 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f
Apr 17 05:36:42 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:42 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614" returned: 0 in 0.529s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:42 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614
Apr 17 05:36:42 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:42 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406" returned: 0 in 0.626s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0 {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:36:42 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Converted 1024.00 MB image at 447.97 MB/s
Apr 17 05:36:42 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0 is being set with open permissions: ugo+rw
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:42 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0
Apr 17 05:36:42 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:42 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f" returned: 0 in 0.483s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:42 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f
Apr 17 05:36:42 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:42 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-93bf47cb-d0c5-476b-9269-8d685d33a614" returned: 0 in 0.428s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-93bf47cb-d0c5-476b-9269-8d685d33a614" released by "delete_volume" :: held 0.979s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created reservations ['ee856d6b-cfb9-4221-a286-f86f77860600', '9eee3959-b0ec-4fba-8c3d-e66f845dcb4f', '03edc70b-d90d-4d8e-9f23-ff809beacd58', '25932f2a-b33a-4c9a-99f4-3b32d52af227'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:42 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:42 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:42 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" returned: 0 in 0.433s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" released by "_copy_volume_from_snapshot" :: held 4.400s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" released by "_create_volume_from_snapshot" :: held 4.428s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.449s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.156s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:42 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Cloning volume a79a6fb6-7b5b-4d82-bce3-0b8537334153 to volume 3f407f04-1caa-437f-8316-46143c9506bd
Apr 17 05:36:42 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Creating offline snapshot 43f067aa-1840-4f05-9f1e-8856dd798e5e of volume a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8303e5b-9a3d-4d91-acf6-6fdad523f109]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2996d9bf-a536-4f1e-be0d-b9afec4f063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0', 'volume_size': 1, 'snapshot_id': '1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a49a43-cfb0-450e-bea2-f3457619aba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:43 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Volume volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0 (2b2a68a6-b810-47e7-9bd5-de95fc6804d0): created successfully
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a49a43-cfb0-450e-bea2-f3457619aba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Flow 'volume_create_manager' (85e86e3d-0a52-4ae4-982e-94d25f598d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:43 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-fe9b96b9-7ead-4e04-9e06-3a4c73ee7f7d tempest-SnapshotDependencyTests-413055425 None] Created volume successfully.
Apr 17 05:36:43 devstack sudo[90537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153
Apr 17 05:36:43 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:43 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-8f2627c9-9add-471e-8e8d-4bf687572a1f" returned: 0 in 0.424s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-quobyte-8f2627c9-9add-471e-8e8d-4bf687572a1f" released by "delete_volume" :: held 0.944s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Created reservations ['8c97af49-3388-4008-a2b9-c6d0576f0187', '570b320a-89d7-4d25-9051-35fe60679893', '2ab52a97-8bf4-41ed-8516-9e25b3e23622', '319ac45e-e9bd-4e36-95df-8c7e295043b2'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:43 devstack sudo[90539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:43 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:43 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.454s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:43 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Deleted volume successfully.
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-84332532-dc2b-41c7-a237-46c10806fdf2 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-93bf47cb-d0c5-476b-9269-8d685d33a614-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:43 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153" returned: 0 in 0.520s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:43 devstack sudo[90545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e 1G
Apr 17 05:36:43 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:43 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.465s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:43 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Deleted volume successfully.
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-6052c3fb-fe57-4f84-b3de-aca20d4761d6 tempest-CreateVolumesFromSnapshotTest-625778028 None] Lock "cinder-8f2627c9-9add-471e-8e8d-4bf687572a1f-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "cinder-1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "cinder-quobyte-522c29cf-4edb-4818-a95d-fd015efbc406" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-522c29cf-4edb-4818-a95d-fd015efbc406" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "cinder-quobyte-1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Deleting offline snapshot 1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 of volume 522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] snapshot_file for this snap is: volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0708f6b7-e29b-435f-a97f-f758138a5a70]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:43 devstack sudo[90548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9
Apr 17 05:36:43 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-02040eef-60da-4e4d-91b3-792cae26adae-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:43 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-02040eef-60da-4e4d-91b3-792cae26adae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-quobyte-02040eef-60da-4e4d-91b3-792cae26adae" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-02040eef-60da-4e4d-91b3-792cae26adae" acquired by "delete_volume" :: waited 0.024s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[22286a4a-c8f8-4928-9c72-5a527e5ca0e2]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:44 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e 1G" returned: 0 in 0.607s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:44 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e
Apr 17 05:36:44 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:44 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae
Apr 17 05:36:44 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:44 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9" returned: 0 in 0.629s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-522c29cf-4edb-4818-a95d-fd015efbc406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02d08a3-b886-4b87-8804-26f5b374a5e3]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:44 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406
Apr 17 05:36:44 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:44 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae" returned: 0 in 0.539s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:44 devstack sudo[90568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae
Apr 17 05:36:44 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:44 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e" returned: 0 in 0.513s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:44 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e is being set with open permissions: ugo+rw
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:44 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e
Apr 17 05:36:44 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:44 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Flow 'volume_create_manager' (b3a12dfb-8707-4314-bf95-8e321927bc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6559b333-78da-4e0d-91d0-979dfb1835b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6559b333-78da-4e0d-91d0-979dfb1835b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71e2099-5d88-4495-b63b-38ca8eb468b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce6f502aa34422ea0eed4197697f1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:45Z,use_quota=True,user_id='655013aa827f4711b69177cb9f1a13f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cdead5-60e5-4b64-a2eb-b37b1aca9f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cdead5-60e5-4b64-a2eb-b37b1aca9f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d103ebd2-8d93-4b95-a806-4eba2d0279ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d103ebd2-8d93-4b95-a806-4eba2d0279ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f71e2099-5d88-4495-b63b-38ca8eb468b3', 'volume_name': 'volume-f71e2099-5d88-4495-b63b-38ca8eb468b3', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf9a6e4-9724-41b6-91c7-afd72551515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf9a6e4-9724-41b6-91c7-afd72551515c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19bc8d5e-27f6-4eb8-8503-9e8462085674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:45 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Volume f71e2099-5d88-4495-b63b-38ca8eb468b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f71e2099-5d88-4495-b63b-38ca8eb468b3', 'volume_size': 1}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:45 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406" returned: 0 in 0.612s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:45 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-02040eef-60da-4e4d-91b3-792cae26adae" returned: 0 in 0.514s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-02040eef-60da-4e4d-91b3-792cae26adae" released by "delete_volume" :: held 1.078s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:45 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9
Apr 17 05:36:45 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:45 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e" returned: 0 in 0.507s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:45 devstack sudo[90579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.info
Apr 17 05:36:45 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created reservations ['71d99267-be25-44e1-ac83-2f12f215c3f1', '4cfddebe-3ed1-4a05-8514-086d6f294fee', '54f1eee8-2d20-4cc0-8e57-345495d0efcd', '14ab21c2-2eb3-4fa2-ba15-add5d86e180e'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:45 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:45 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:45 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.info" returned: 0 in 0.438s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:45 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.info is being set with open permissions: ugo+rw
Apr 17 05:36:45 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9" returned: 0 in 0.493s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:45 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.info
Apr 17 05:36:45 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:45 devstack sudo[90589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9
Apr 17 05:36:45 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:45 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.411s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:45 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Deleted volume successfully.
Apr 17 05:36:45 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-29c77c7b-ecf4-463c-aee5-1a023aad0bd6 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-02040eef-60da-4e4d-91b3-792cae26adae-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:46 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.info" returned: 0 in 0.425s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:46 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-quobyte-3f407f04-1caa-437f-8316-46143c9506bd" by "_copy_volume_from_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406.1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9" returned: 0 in 0.430s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-3f407f04-1caa-437f-8316-46143c9506bd" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] snapshot: 43f067aa-1840-4f05-9f1e-8856dd798e5e, volume: 3f407f04-1caa-437f-8316-46143c9506bd,  {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3852ec-6793-4c20-8868-2de4320f8c71]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9" released by "_delete_snapshot" :: held 2.250s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-522c29cf-4edb-4818-a95d-fd015efbc406" released by "delete_snapshot" :: held 2.267s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Created reservations ['c0b206e5-953f-41d8-b5c3-2a871eab6286', '5acd1625-8e64-43d1-82e8-6a0a8c9c3cf3', '4bedf48f-a40d-40c8-9a7b-c07ae9894f37', '3ac39e99-1df1-457d-8c3d-120844413ad8'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:46 devstack sudo[90596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e
Apr 17 05:36:46 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-11609b3a-5235-4af7-b318-178ad87c4624-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:46 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Delete snapshot completed successfully.
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-11609b3a-5235-4af7-b318-178ad87c4624-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a8e22fa-8921-402b-8d14-d7c715c032ca tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-1e5ef6e0-bd63-403a-8a52-cf6f6bbc5ad9-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-quobyte-11609b3a-5235-4af7-b318-178ad87c4624" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-11609b3a-5235-4af7-b318-178ad87c4624" acquired by "delete_volume" :: waited 0.017s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[904da002-f6f7-406b-ac49-946b4464f4ec]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:46 devstack sudo[90598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624
Apr 17 05:36:46 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:46 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e" returned: 0 in 0.494s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Creating direct copy from snapshot {{(pid=82266) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d68ca2c-7817-4fd1-be1e-a87a114fe632]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:46 devstack sudo[90603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153
Apr 17 05:36:46 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:46 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624" returned: 0 in 0.507s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:46 devstack sudo[90614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624
Apr 17 05:36:46 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "cinder-522c29cf-4edb-4818-a95d-fd015efbc406-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-522c29cf-4edb-4818-a95d-fd015efbc406-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "cinder-quobyte-522c29cf-4edb-4818-a95d-fd015efbc406" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:46 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-522c29cf-4edb-4818-a95d-fd015efbc406" acquired by "delete_volume" :: waited 0.017s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd2c618-e585-411f-963d-4d9db6e4f148]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:47 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153" returned: 0 in 0.500s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG cinder.utils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Path /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd not found in is_blk_device check {{(pid=82266) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:47 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406
Apr 17 05:36:47 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:47 devstack sudo[90621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd
Apr 17 05:36:47 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:47 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-11609b3a-5235-4af7-b318-178ad87c4624" returned: 0 in 0.447s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-11609b3a-5235-4af7-b318-178ad87c4624" released by "delete_volume" :: held 0.975s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created reservations ['d6f62706-dc57-4dda-b87c-a47963f294a7', '2391bd27-1ce7-4c74-8d23-3a0f7bdb151a', '52439aed-6b70-4d92-abf3-80b1a16554ec', '283079a7-10f1-481b-8137-f08e5861cf62'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:47 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:47 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:47 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406" returned: 0 in 0.627s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:47 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:47 devstack sudo[90640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406
Apr 17 05:36:47 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:48 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.833s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:48 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Deleted volume successfully.
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-ba68c8ad-1064-4d5b-83ea-36ff13c5f430 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-11609b3a-5235-4af7-b318-178ad87c4624-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-938c7cb3-ff5b-4242-9757-debd00b98a3d-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-938c7cb3-ff5b-4242-9757-debd00b98a3d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-quobyte-938c7cb3-ff5b-4242-9757-debd00b98a3d" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-938c7cb3-ff5b-4242-9757-debd00b98a3d" acquired by "delete_volume" :: waited 0.044s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4310e15c-d822-494a-b390-be803dd7aa37]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:48 devstack sudo[90644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d
Apr 17 05:36:48 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:48 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-522c29cf-4edb-4818-a95d-fd015efbc406" returned: 0 in 1.166s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-522c29cf-4edb-4818-a95d-fd015efbc406" released by "delete_volume" :: held 1.834s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Created reservations ['bfa3022f-099b-4bcc-b947-76bef4c6b36c', '0718c561-42b2-4b46-a421-a4a7510089d4', '3bec2bfc-6ee4-4a87-a099-ff0d79ebd7e8', '6e819c47-be79-49b4-884b-5aa8e0dce715'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:48 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:49 devstack sudo[90646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:49 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "cinder-2b2a68a6-b810-47e7-9bd5-de95fc6804d0-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-2b2a68a6-b810-47e7-9bd5-de95fc6804d0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "cinder-quobyte-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" acquired by "delete_volume" :: waited 0.012s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:49 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd" returned: 0 in 2.257s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8ccbb5-174d-4558-971c-391be4dee4d3]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caced5e-820d-4ca1-959b-d7b4206a5ee9]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:49 devstack sudo[90649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0
Apr 17 05:36:49 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:49 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d" returned: 0 in 0.772s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:49 devstack sudo[90652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153
Apr 17 05:36:49 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:49 devstack sudo[90655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d
Apr 17 05:36:49 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:49 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.562s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:49 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Deleted volume successfully.
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-196d8159-9e6d-4c69-8528-ce7213214e4a tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-522c29cf-4edb-4818-a95d-fd015efbc406-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:49 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" returned: 0 in 0.495s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:49 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0
Apr 17 05:36:49 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:49 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-938c7cb3-ff5b-4242-9757-debd00b98a3d" returned: 0 in 0.431s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-938c7cb3-ff5b-4242-9757-debd00b98a3d" released by "delete_volume" :: held 1.244s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created reservations ['0988e3c9-7bb3-410c-a5ca-c0c4a1b4c521', 'dba1c4b9-02f2-4601-a826-de364e24b248', '93940992-621a-477b-ad0f-899e29a8b59f', '3cbc036d-fa30-446a-adf6-fc476eaf1627'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:49 devstack sudo[90667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:49 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:49 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153" returned: 0 in 0.634s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG cinder.image.image_utils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd {{(pid=82266) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 17 05:36:49 devstack cinder-volume[82266]: INFO cinder.image.image_utils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Converted 1024.00 MB image at 453.60 MB/s
Apr 17 05:36:49 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd is being set with open permissions: ugo+rw
Apr 17 05:36:49 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:50 devstack sudo[90669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd
Apr 17 05:36:50 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:50 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" returned: 0 in 0.443s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-quobyte-2b2a68a6-b810-47e7-9bd5-de95fc6804d0" released by "delete_volume" :: held 0.971s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Created reservations ['dadc66f3-84bd-4c2b-9e63-4db0ee4eb3d8', 'e32804ca-5b6f-4054-9931-bf10035da96f', '270d25e4-54f9-4d65-8832-0d8eaf715a41', 'a0450baa-4473-4000-9405-8f7ceb3be50d'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:50 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.461s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:50 devstack sudo[90674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:50 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:50 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Deleted volume successfully.
Apr 17 05:36:50 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-d039af69-0c20-465a-90e5-61f43cf9bfc9 tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-938c7cb3-ff5b-4242-9757-debd00b98a3d-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd" returned: 0 in 0.454s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-3f407f04-1caa-437f-8316-46143c9506bd" released by "_copy_volume_from_snapshot" :: held 4.394s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-quobyte-43f067aa-1840-4f05-9f1e-8856dd798e5e" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-43f067aa-1840-4f05-9f1e-8856dd798e5e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Deleting offline snapshot 43f067aa-1840-4f05-9f1e-8856dd798e5e of volume a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] snapshot_file for this snap is: volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec637d92-8cdb-4336-951f-81eacc93b051]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:50 devstack sudo[90676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e
Apr 17 05:36:50 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "cinder-quobyte-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10" acquired by "delete_volume" :: waited 0.020s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4414f307-1c62-44d3-8ca4-e1b9f58c34fb]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:50 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:50 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Deleted volume successfully.
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-24311149-76e5-4214-96c9-5a44db62430d tempest-SnapshotDependencyTests-413055425 None] Lock "cinder-2b2a68a6-b810-47e7-9bd5-de95fc6804d0-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:50 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10
Apr 17 05:36:50 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:50 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e" returned: 0 in 0.501s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7a38e0-d8dd-46da-8dd1-0da39d295e7c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:50 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:51 devstack sudo[90684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153
Apr 17 05:36:51 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:51 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10" returned: 0 in 0.507s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:51 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10
Apr 17 05:36:51 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:51 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153" returned: 0 in 0.503s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:51 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e
Apr 17 05:36:51 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:51 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10" returned: 0 in 0.435s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-quobyte-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10" released by "delete_volume" :: held 0.964s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Created reservations ['85aec250-623c-4659-86d4-3393fdd9327b', 'db662600-f976-4da7-8a12-cbc5c790ddc2', 'cbc7ac41-6727-487d-b365-193e4627aa18', '2c6c56db-cea6-421c-9287-67255b7dde60'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:51 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:51 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:51 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:52 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e" returned: 0 in 0.509s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:52 devstack sudo[90702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e
Apr 17 05:36:52 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:52 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.545s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:52 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Deleted volume successfully.
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-9a1e3cfd-c724-4b4e-bfee-3a9751765d6b tempest-CreateVolumesFromSourceVolumeTest-1927437715 None] Lock "cinder-6cc57244-4a4c-47c9-a6a7-ed317b1a1b10-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:52 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153.43f067aa-1840-4f05-9f1e-8856dd798e5e" returned: 0 in 0.488s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-43f067aa-1840-4f05-9f1e-8856dd798e5e" released by "_delete_snapshot" :: held 2.045s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.574s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.470s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71e2099-5d88-4495-b63b-38ca8eb468b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce6f502aa34422ea0eed4197697f1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:45Z,use_quota=True,user_id='655013aa827f4711b69177cb9f1a13f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Creating volume f71e2099-5d88-4495-b63b-38ca8eb468b3 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:52 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac98c1e-4c13-4421-a782-cc14d32dc24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f407f04-1caa-437f-8316-46143c9506bd', 'volume_size': 1, 'source_volid': 'a79a6fb6-7b5b-4d82-bce3-0b8537334153', 'source_volstatus': 'available'}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:52 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3 1073741824
Apr 17 05:36:52 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b91186-01a5-44f5-887e-643198e32ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:52 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Volume volume-3f407f04-1caa-437f-8316-46143c9506bd (3f407f04-1caa-437f-8316-46143c9506bd): created successfully
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b91186-01a5-44f5-887e-643198e32ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Flow 'volume_create_manager' (fd0c5679-c973-46a1-ae15-69f20981a5fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:52 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-31c04d4f-300a-4ef4-9ade-f764b91318a8 tempest-VolumeDependencyTests-381097656 None] Created volume successfully.
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_service.periodic_task [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:52 devstack sudo[90709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:52 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-a79a6fb6-7b5b-4d82-bce3-0b8537334153-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Lock "cinder-a79a6fb6-7b5b-4d82-bce3-0b8537334153-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-quobyte-a79a6fb6-7b5b-4d82-bce3-0b8537334153" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-a79a6fb6-7b5b-4d82-bce3-0b8537334153" acquired by "delete_volume" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[02196693-3951-464a-ad79-ab6ba97be2ce]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:52 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:53 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153
Apr 17 05:36:53 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:53 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3 1073741824" returned: 0 in 0.806s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:53 devstack sudo[90717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3
Apr 17 05:36:53 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:53 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.599s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-daeb6c79-0e78-4b2a-9225-56af3b5b1a02 None None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:53 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153" returned: 0 in 0.584s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:53 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153
Apr 17 05:36:53 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:53 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3" returned: 0 in 0.474s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19bc8d5e-27f6-4eb8-8503-9e8462085674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f71e2099-5d88-4495-b63b-38ca8eb468b3', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0000d1da-5477-471a-a9bb-7306bafe6f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:53 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Volume volume-f71e2099-5d88-4495-b63b-38ca8eb468b3 (f71e2099-5d88-4495-b63b-38ca8eb468b3): created successfully
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0000d1da-5477-471a-a9bb-7306bafe6f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:53 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Flow 'volume_create_manager' (b3a12dfb-8707-4314-bf95-8e321927bc91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:53 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-1aa9e281-d557-4798-99e6-019dac0550e9 tempest-CinderUnicodeTest-873851760 None] Created volume successfully.
Apr 17 05:36:54 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-a79a6fb6-7b5b-4d82-bce3-0b8537334153" returned: 0 in 0.534s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-a79a6fb6-7b5b-4d82-bce3-0b8537334153" released by "delete_volume" :: held 1.151s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Created reservations ['ea40ba63-cd17-49ef-99dd-456d6c968de5', '062fa6f2-149f-49bd-8fab-444f1bc08b5d', '63704cd1-3bd1-43ef-8ce0-7584134c8b8d', '36a0135a-c766-4395-a068-eca9002a26c8'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:54 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:54 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:54 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.432s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:54 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Deleted volume successfully.
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-098c7ac8-10d6-4e4e-a8c2-bd4dc83c4bcc tempest-VolumeDependencyTests-381097656 None] Lock "cinder-a79a6fb6-7b5b-4d82-bce3-0b8537334153-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.flows.manager.create_volume [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82266) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Flow 'volume_create_manager' (99f8388b-057a-4c70-a213-cb6af22f203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f789a8c-935b-43bc-b127-ea529c2be73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f789a8c-935b-43bc-b127-ea529c2be73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1900144182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236a2c08-a1c2-4438-bc74-8e192618c2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce6f502aa34422ea0eed4197697f1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:55Z,use_quota=True,user_id='655013aa827f4711b69177cb9f1a13f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4558e3d-8b62-4d5d-9b1b-11bc35bd93ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4558e3d-8b62-4d5d-9b1b-11bc35bd93ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0b8e43-1eb2-4767-9d1a-277b4ebc93e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0b8e43-1eb2-4767-9d1a-277b4ebc93e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '236a2c08-a1c2-4438-bc74-8e192618c2d5', 'volume_name': 'volume-236a2c08-a1c2-4438-bc74-8e192618c2d5', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b956a1-5d5f-4e13-a4d1-19cb464491bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b956a1-5d5f-4e13-a4d1-19cb464491bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9d85bc-e30f-4d4b-b3c9-6e8e785ef565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:54 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Volume 236a2c08-a1c2-4438-bc74-8e192618c2d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-236a2c08-a1c2-4438-bc74-8e192618c2d5', 'volume_size': 1}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f536e7941c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-17T03:36:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1900144182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236a2c08-a1c2-4438-bc74-8e192618c2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce6f502aa34422ea0eed4197697f1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T03:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T03:36:55Z,use_quota=True,user_id='655013aa827f4711b69177cb9f1a13f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11447d49-2359-4bdd-9eb0-b41c5696c26a),volume_type_id=11447d49-2359-4bdd-9eb0-b41c5696c26a)}" {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Creating volume 236a2c08-a1c2-4438-bc74-8e192618c2d5 {{(pid=82266) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Selected osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12 as target Quobyte volume. {{(pid=82266) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 17 05:36:54 devstack cinder-volume[82266]: INFO cinder.volume.drivers.remotefs [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] casted to osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12
Apr 17 05:36:54 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 1073741824 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:54 devstack sudo[90730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 1073741824
Apr 17 05:36:54 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-3f407f04-1caa-437f-8316-46143c9506bd-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-3f407f04-1caa-437f-8316-46143c9506bd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-quobyte-3f407f04-1caa-437f-8316-46143c9506bd" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-3f407f04-1caa-437f-8316-46143c9506bd" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5c7163-51a9-44b3-b2b8-4355135d07ca]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:55 devstack sudo[90732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd
Apr 17 05:36:55 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:55 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 1073741824" returned: 0 in 0.559s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:55 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5
Apr 17 05:36:55 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:55 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd" returned: 0 in 0.526s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:55 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd
Apr 17 05:36:55 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:55 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5" returned: 0 in 0.462s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'} {{(pid=82266) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9d85bc-e30f-4d4b-b3c9-6e8e785ef565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-236a2c08-a1c2-4438-bc74-8e192618c2d5', 'volume_size': 1}' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d47cfed-fde4-4993-807d-b49177ce00a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 17 05:36:55 devstack cinder-volume[82266]: INFO cinder.volume.flows.manager.create_volume [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Volume volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 (236a2c08-a1c2-4438-bc74-8e192618c2d5): created successfully
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d47cfed-fde4-4993-807d-b49177ce00a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82266) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 17 05:36:55 devstack cinder-volume[82266]: DEBUG cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Flow 'volume_create_manager' (99f8388b-057a-4c70-a213-cb6af22f203f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82266) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 17 05:36:56 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-96776d9e-b8d9-4417-847b-1f4056060990 tempest-CinderUnicodeTest-873851760 None] Created volume successfully.
Apr 17 05:36:56 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-3f407f04-1caa-437f-8316-46143c9506bd" returned: 0 in 0.471s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-3f407f04-1caa-437f-8316-46143c9506bd" released by "delete_volume" :: held 1.023s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Created reservations ['c25199db-2ec8-4344-b4db-fc610b648ec2', '392a769f-2cc5-4892-adf5-ef6d401bce41', 'e0425a59-b4a8-4e10-9129-89085fcd04d2', '0d0c8217-9c86-46e0-9ddb-17ceed17419e'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:56 devstack sudo[90747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:56 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:56 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.485s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:56 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Deleted volume successfully.
Apr 17 05:36:56 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-80d1689c-e9e5-4716-a365-07ffb4684f44 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-3f407f04-1caa-437f-8316-46143c9506bd-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Creating offline snapshot 0953699a-1257-4368-9fdc-6a1891c80273 of volume 236a2c08-a1c2-4438-bc74-8e192618c2d5 {{(pid=82266) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f48b2d-118f-4a38-a80d-e3690ebe718b]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:57 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5
Apr 17 05:36:57 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-7a63e9b0-4a5d-4310-b873-f51bab4be96f-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-7a63e9b0-4a5d-4310-b873-f51bab4be96f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "cinder-quobyte-7a63e9b0-4a5d-4310-b873-f51bab4be96f" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-7a63e9b0-4a5d-4310-b873-f51bab4be96f" acquired by "delete_volume" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4655e52d-d1ea-44c5-b1e6-76ff6d759263]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:57 devstack sudo[90754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f
Apr 17 05:36:57 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:57 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5" returned: 0 in 0.562s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273 1G {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:57 devstack sudo[90759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273 1G
Apr 17 05:36:57 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:57 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f" returned: 0 in 0.577s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:57 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:57 devstack sudo[90765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f
Apr 17 05:36:57 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:58 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273 1G" returned: 0 in 0.579s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:58 devstack sudo[90770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273
Apr 17 05:36:58 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:58 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-7a63e9b0-4a5d-4310-b873-f51bab4be96f" returned: 0 in 0.496s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-quobyte-7a63e9b0-4a5d-4310-b873-f51bab4be96f" released by "delete_volume" :: held 1.099s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Created reservations ['388a4414-a3a1-496b-a3e4-15a1169fda4b', '2cabc188-d03d-4837-a1a6-54ad238a0c8a', '025ba458-0e32-405a-9764-f3b2841e344f', '00d1e4c9-d47c-447a-bf21-6617c559f13d'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:58 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:36:58 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:58 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 -F qcow2 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273" returned: 0 in 0.439s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:58 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273 is being set with open permissions: ugo+rw
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:58 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273
Apr 17 05:36:58 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:58 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.403s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:36:58 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Deleted volume successfully.
Apr 17 05:36:58 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-b7011b75-5cb0-4800-bc92-604643931362 tempest-VolumeDependencyTests-381097656 None] Lock "cinder-7a63e9b0-4a5d-4310-b873-f51bab4be96f-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:36:59 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273" returned: 0 in 0.409s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:59 devstack sudo[90782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.info
Apr 17 05:36:59 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:59 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root
Apr 17 05:36:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.info" returned: 0 in 0.410s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:36:59 devstack cinder-volume[82266]: WARNING cinder.volume.drivers.remotefs [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.info is being set with open permissions: ugo+rw
Apr 17 05:36:59 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.info {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:36:59 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.info
Apr 17 05:36:59 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:36:59 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.info" returned: 0 in 0.406s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.859s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:37:00 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-26ab2239-9ddf-4d69-848d-bde6bce98870 tempest-CinderUnicodeTest-873851760 None] Create snapshot completed successfully
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "cinder-0953699a-1257-4368-9fdc-6a1891c80273-delete_snapshot" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-0953699a-1257-4368-9fdc-6a1891c80273-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "cinder-quobyte-236a2c08-a1c2-4438-bc74-8e192618c2d5" by "delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-quobyte-236a2c08-a1c2-4438-bc74-8e192618c2d5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "cinder-quobyte-0953699a-1257-4368-9fdc-6a1891c80273" by "_delete_snapshot" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-quobyte-0953699a-1257-4368-9fdc-6a1891c80273" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Deleting offline snapshot 0953699a-1257-4368-9fdc-6a1891c80273 of volume 236a2c08-a1c2-4438-bc74-8e192618c2d5 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] snapshot_file for this snap is: volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273 {{(pid=82266) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8641c8-469f-40d6-a40f-86497131c615]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:37:00 devstack sudo[90788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273
Apr 17 05:37:00 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:37:00 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273" returned: 0 in 0.478s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.remotefs [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236a2c08-a1c2-4438-bc74-8e192618c2d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82266) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43a783d-fb91-4bb8-b723-cd3378a9577e]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:37:00 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:37:00 devstack sudo[90793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5
Apr 17 05:37:00 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:37:01 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5" returned: 0 in 0.473s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:37:01 devstack sudo[90798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273
Apr 17 05:37:01 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:37:01 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273" returned: 0 in 0.457s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:01 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:37:01 devstack sudo[90803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273
Apr 17 05:37:01 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:37:02 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5.0953699a-1257-4368-9fdc-6a1891c80273" returned: 0 in 0.408s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-quobyte-0953699a-1257-4368-9fdc-6a1891c80273" released by "_delete_snapshot" :: held 1.884s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-quobyte-236a2c08-a1c2-4438-bc74-8e192618c2d5" released by "delete_snapshot" :: held 1.900s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Created reservations ['9d08ebee-c47b-482d-b493-0c7bc09f6571', 'a3840412-8745-4a53-b188-3f35c247aacb', '979826f5-0fe0-424c-9b7e-36ad9a3775ad', 'e526d0f4-541c-4549-af92-6fc0aa88250d'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:37:02 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Delete snapshot completed successfully.
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-65d84035-b8b7-4ae0-81c5-b83ab0a5dd12 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-0953699a-1257-4368-9fdc-6a1891c80273-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "cinder-236a2c08-a1c2-4438-bc74-8e192618c2d5-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-236a2c08-a1c2-4438-bc74-8e192618c2d5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "cinder-quobyte-236a2c08-a1c2-4438-bc74-8e192618c2d5" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-quobyte-236a2c08-a1c2-4438-bc74-8e192618c2d5" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f394c37e-c357-48d0-98a8-7b917682155c]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:37:02 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5
Apr 17 05:37:02 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:37:02 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5" returned: 0 in 0.460s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:02 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:37:02 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5
Apr 17 05:37:02 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:37:03 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-236a2c08-a1c2-4438-bc74-8e192618c2d5" returned: 0 in 0.401s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-quobyte-236a2c08-a1c2-4438-bc74-8e192618c2d5" released by "delete_volume" :: held 0.898s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Created reservations ['16bebbd1-dda8-4d84-a958-504d7b89f9b1', '995074db-2cd7-4000-972d-6dd190d4aa1f', 'da668f7d-9736-4571-9da6-a3d593d01771', '247e4fdb-ae35-4fe3-9b86-a13a6de24da0'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:37:03 devstack sudo[90814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:37:03 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "cinder-f71e2099-5d88-4495-b63b-38ca8eb468b3-delete_volume" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-f71e2099-5d88-4495-b63b-38ca8eb468b3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "cinder-quobyte-f71e2099-5d88-4495-b63b-38ca8eb468b3" by "delete_volume" {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-quobyte-f71e2099-5d88-4495-b63b-38ca8eb468b3" acquired by "delete_volume" :: waited 0.007s {{(pid=82266) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG oslo.privsep.daemon [-] privsep: reply[849cc077-b851-4094-8308-7578525beb54]: (4, 'qcow2') {{(pid=83012) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:37:03 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3
Apr 17 05:37:03 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:37:03 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:37:03 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Deleted volume successfully.
Apr 17 05:37:03 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-30c8f0a6-6635-4b35-92aa-28f31e0c51d9 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-236a2c08-a1c2-4438-bc74-8e192618c2d5-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:37:04 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3" returned: 0 in 0.458s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:37:04 devstack sudo[90822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3
Apr 17 05:37:04 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:37:04 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772/volume-f71e2099-5d88-4495-b63b-38ca8eb468b3" returned: 0 in 0.427s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-quobyte-f71e2099-5d88-4495-b63b-38ca8eb468b3" released by "delete_volume" :: held 0.903s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=218,cinder:UPDATE=294,cinder:INSERT=58,cinder:DELETE=31 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:UPDATE=296,cinder:SELECT=206,cinder:DELETE=22,cinder:INSERT=83 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG cinder.quota [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Created reservations ['686ad751-15d1-408b-b0a2-5d99298e9051', 'eecbf16f-645b-4b94-9f77-9e8b2faa6a54', '1a77c345-95c3-4e78-a764-567facf45812', 'c706e98b-badf-43c2-91fa-ea713826fe64'] {{(pid=82266) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12': None} {{(pid=82266) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG cinder.volume.drivers.quobyte [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e7642a6-0147-4cfc-92c6-86e2e2c93b12'] {{(pid=82266) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.lockutils [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772 {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 17 05:37:04 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772
Apr 17 05:37:04 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 17 05:37:04 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG oslo_concurrency.processutils [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0dbd85de63b361a51f4bfb6d963a772" returned: 0 in 0.420s {{(pid=82266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG cinder.manager [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Notifying Schedulers of capabilities ... {{(pid=82266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 17 05:37:04 devstack cinder-volume[82266]: INFO cinder.volume.manager [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Deleted volume successfully.
Apr 17 05:37:04 devstack cinder-volume[82266]: DEBUG cinder.coordination [None req-33fa0196-2759-498b-bab8-42da6ebc6bc9 tempest-CinderUnicodeTest-873851760 None] Lock "cinder-f71e2099-5d88-4495-b63b-38ca8eb468b3-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82266) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 17 05:37:14 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 17 05:37:14 devstack cinder-volume[82266]: DEBUG dbcounter [-] [82266] Writing DB stats cinder:INSERT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}